00000001:02000400:1.0F:1788940458.493522:0:2956:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg217-server.virtnet: executing set_hostid 00000001:02000400:1.0:1788940490.629106:0:3178:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg217-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1788940493.034844:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 591 MB/s 00000001:01000000:1.0:1788940493.284641:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 531 MB/s 00000001:01000000:1.0:1788940493.535421:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4521 MB/s 00000020:02000000:2.0F:1788940494.507621:0:3270:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_40_gec2f674 00000400:02000000:2.0:1788940495.593629:0:3285:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.117@tcp [8/256/0/180] 00008000:02000000:2.0:1788940499.540018:0:3435:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0F:1788940559.185496:0:5240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg217-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788940570.063181:0:5813:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788940570.063233:0:5813:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788940570.063411:0:5813:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000033a47953 00000080:02000400:2.0:1788940570.063428:0:5813:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788940570.072717:0:5813:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788940570.072730:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788940570.072847:0:5813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004efbc093) 00000020:00000080:3.0:1788940570.072868:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788940570.087716:0:5813:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788940570.088091:0:5813:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788940570.128058:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788940570.128101:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788940570.128123:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788940570.128175:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788940570.128246:0:5813:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788940570.128998:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788940570.129008:0:5813:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788940570.129020:0:5813:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa1d8aa9164aa2969 00000020:01000004:3.0:1788940570.129029:0:5813:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788940570.129034:0:5813:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788940570.129038:0:5813:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000033a47953 from MGS 00000020:01000004:3.0:1788940570.129044:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788940570.129057:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000028009feb) 00000020:00000080:3.0:1788940570.129070:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788940570.129130:0:5813:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000033a47953 from MGS, refs=2 00080000:01000000:3.0:1788940570.129135:0:5813:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788940570.129140:0:5813:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa1d8aa9164aa2977 00000100:00100000:3.0:1788940570.129268:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788940570.129529:0:5813:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788940570.129536:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788940570.130362:0:5813:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788940570.130371:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788940570.131181:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940570.131426:0:5813:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788940570.131432:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788940570.132318:0:5813:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788940570.132327:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788940570.135082:0:5813:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788940570.135116:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788940570.136101:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940570.136106:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940570.136107:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940570.136574:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940570.136577:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940570.136578:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940570.137260:0:5813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788940570.150871:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788940570.386604:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2015 MB/s 00000001:01000000:2.0:1788940570.636344:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2911 MB/s 00000001:01000000:0.0:1788940570.886755:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 383 MB/s 00000001:01000000:3.0:1788940571.141957:0:5813:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 603 MB/s 00080000:10000000:1.0:1788940571.166847:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1788940571.192698:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788940571.192718:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788940571.192721:0:5813:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788940571.204168:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788940571.204266:0:5813:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788940571.204356:0:5813:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788940571.204656:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788940571.204692:0:5813:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788940571.205078:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940571.205307:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788940571.205314:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:0.0:1788940571.212522:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940571.212961:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788940571.212972:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788940571.218509:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788940571.218523:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788940571.225389:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788940571.225417:0:5813:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.117@tcp' 00000020:01000004:0.0:1788940571.225419:0:5813:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788940571.225470:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.117@tcp (typ=mgc) 00000020:00000080:0.0:1788940571.225503:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.117@tcp (0000000057497404) 00000020:00000080:0.0:1788940571.225523:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788940571.225660:0:5813:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000080c4e1b2@MGC192.168.202.117@tcp: add connection 192.168.202.117@tcp at head 00010000:00010000:0.0:1788940571.225815:0:5813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.117@tcp-0 is initialized 00000040:01000000:0.0:1788940571.225822:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.117@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788940571.226767:0:5829:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788940571.229392:0:5830:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788940571.229439:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.117@tcp (uuid d726abb2-e4c2-4da6-a0b4-cf7a68b51e04) 00000020:00000080:0.0:1788940571.229464:0:5813:0:(genops.c:1384:class_connect()) connect: client d726abb2-e4c2-4da6-a0b4-cf7a68b51e04, cookie 0xa1d8aa9164aa2985 00000100:00080000:0.0:1788940571.229478:0:5813:0:(import.c:545:import_select_connection()) MGC192.168.202.117@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940571.229490:0:5813:0:(import.c:666:import_select_connection()) MGC192.168.202.117@tcp: import 0000000080c4e1b2 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:0.0:1788940571.229536:0:5813:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009a966363 x1875840068485248/t0(0) o250->MGC192.168.202.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940571.229557:0:5813:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d726abb2-e4c2-4da6-a0b4-cf7a68b51e04->MGS 00000020:01000004:0.0:1788940571.229576:0:5813:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788940571.229585:0:5813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788940571.229597:0:5813:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007a2a5b59) 00000020:00000080:0.0:1788940571.229608:0:5813:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788940571.232986:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a966363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3300:1875840068485248:0@lo:250: 00000100:00100000:1.0:1788940571.233070:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940571.237606:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068485248 00000100:00100000:3.0:1788940571.237626:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068485248 00000100:00100000:3.0:1788940571.237677:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940571.237683:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7a94f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3300:x1875840068485248:12345-0@lo:250: 00010000:00080000:3.0:1788940571.237713:0:5826:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from d726abb2-e4c2-4da6-a0b4-cf7a68b51e04@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1788940571.237740:0:5826:0:(genops.c:1384:class_connect()) connect: client d726abb2-e4c2-4da6-a0b4-cf7a68b51e04, cookie 0xa1d8aa9164aa2993 00000100:00080000:3.0:1788940571.237870:0:5826:0:(import.c:65:import_set_state_nolock()) 00000000534e7673 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940571.237968:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7a94f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+5:3300:x1875840068485248:12345-0@lo:250: Request processed in 284us (4898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940571.237976:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940571.238035:0:3300:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.117@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788940571.238046:0:3300:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.117@tcp: connect to target with instance 0 00000100:00080000:3.0:1788940571.238053:0:3300:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.117@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788940571.238058:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788940571.238061:0:3300:0:(import.c:65:import_set_state_nolock()) 0000000080c4e1b2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788940571.238064:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788940571.238073:0:3300:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788940571.238077:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a966363 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3300:1875840068485248:0@lo:250: 00000100:00100000:0.0:1788940571.247224:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940571.260585:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788940571.260595:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788940571.262013:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788940571.262027:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788940571.262835:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788940571.262845:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788940571.264170:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940571.265981:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788940571.265991:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788940571.266748:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788940571.266755:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788940571.347611:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940571.347858:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788940571.347864:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788940571.350581:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788940571.350595:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788940571.351170:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940571.351523:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788940571.351529:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788940571.358776:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788940571.358790:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788940571.359734:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940571.359926:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788940571.359936:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788940571.360708:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788940571.360717:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788940571.361281:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940571.361493:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788940571.361499:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788940571.361991:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788940571.361999:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788940571.390845:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940571.391117:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788940571.391126:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788940571.392702:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788940571.392714:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788940571.394649:0:5813:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788940571.394663:0:5813:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788940571.396108:0:5813:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788940571.396135:0:5813:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788940571.396141:0:5813:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.117@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788940571.396608:0:5813:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.117@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788940571.396643:0:5813:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.117@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788940571.396648:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788940571.396650:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788940571.396651:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940571.396653:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940571.396654:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940571.396655:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940571.396656:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940571.396657:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788940571.396659:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940571.396660:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940571.396662:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940571.396663:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940571.396665:0:5813:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788940571.396668:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940571.396669:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788940571.396670:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940571.396671:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940571.396672:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940571.396673:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940571.396674:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940571.396675:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788940571.396676:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940571.396677:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940571.396678:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940571.396678:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940571.396720:0:5813:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788940571.396740:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e54539d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068485376:0@lo:253: 00000100:00100000:2.0:1788940571.396832:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940571.396937:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aeb948a8 going to sleep for 11 seconds 00000100:00100000:0.0:1788940571.397023:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068485376 00000100:00100000:0.0:1788940571.397032:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068485376 00000100:00100000:0.0:1788940571.397112:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940571.397122:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fff1d431 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+5:5813:x1875840068485376:12345-0@lo:253: 20000000:01000000:0.0:1788940571.397168:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788940571.397171:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788940571.397748:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788940571.397804:0:5828:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788940571.398124:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940571.399455:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788940571.399709:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788940571.399715:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788940571.399731:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788940571.399735:0:5828:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788940571.399754:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788940571.399989:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940571.400606:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788940571.400622:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788940571.400676:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788940571.400725:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788940571.400761:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788940571.400857:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788940571.400866:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788940571.400910:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788940571.400919:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788940571.400950:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788940571.400957:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788940571.400985:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788940571.401029:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788940571.401076:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788940571.401085:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788940571.401106:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940571.401391:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788940571.401402:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788940571.401437:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788940571.401485:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788940571.401535:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788940571.401547:0:5828:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788940571.401617:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788940571.401624:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788940571.401665:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788940571.401701:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788940571.401735:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788940571.401746:0:5828:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788940571.401864:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788940571.401875:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788940571.401908:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788940571.401941:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788940571.402102:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788940571.402147:0:5828:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788940571.402155:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788940571.405086:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788940571.405781:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788940571.405811:0:5828:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.117@tcp for mdt 20000000:01000000:0.0:1788940571.405814:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.117@tcp (null) (null) (null) 00000040:00080000:0.0:1788940571.405849:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788940571.405857:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788940571.405889:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788940571.405896:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.117@tcp (null) (null) 00000040:00080000:0.0:1788940571.405940:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788940571.405949:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788940571.405980:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788940571.406030:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788940571.406092:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788940571.406096:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788940571.406101:0:5828:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788940571.406108:0:5828:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788940571.406766:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1788940571.407073:0:5828:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788940571.417181:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788940571.417289:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1788940571.417384:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1788940571.417407:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788940571.417410:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788940571.417415:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788940571.417466:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788940571.417469:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788940571.417501:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788940571.417503:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788940571.419317:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788940571.420043:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788940571.420124:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788940571.420163:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788940571.420177:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788940571.420179:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788940571.421093:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1788940571.421389:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1788940571.421454:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1788940571.421548:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:0.0:1788940571.421565:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788940571.421567:0:5828:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1788940571.421575:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788940571.421596:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000aec18225/0xa1d8aa9164aa299a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940571.421614:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aec18225/0xa1d8aa9164aa299a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940571.421645:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aec18225/0xa1d8aa9164aa299a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940571.421651:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000aec18225/0xa1d8aa9164aa299a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940571.421657:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000aec18225/0xa1d8aa9164aa299a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940571.421663:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000aec18225/0xa1d8aa9164aa299a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940571.421669:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aec18225 already unused, calling callback (000000009b6825e3) 00010000:00010000:0.0:1788940571.421672:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000aec18225/0xa1d8aa9164aa299a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940571.421678:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000aec18225/0xa1d8aa9164aa299a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940571.421691:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000aec18225/0xa1d8aa9164aa299a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940571.421697:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000aec18225/0xa1d8aa9164aa299a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940571.421703:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aec18225/0xa1d8aa9164aa299a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788940571.421720:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788940571.742359:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fff1d431 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+5:5813:x1875840068485376:12345-0@lo:253: Request processed in 345232us (345521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940571.742379:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940571.742491:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e54539d2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068485376:0@lo:253: 10000000:01000000:0.0:1788940571.742541:0:5813:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788940571.742544:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940571.742546:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788940571.742547:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940571.742549:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788940571.742550:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940571.742551:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940571.742552:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788940571.742554:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788940571.742555:0:5813:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788940571.742556:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940571.742557:0:5813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788940571.742574:0:5813:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000033a47953 from lustre-MDT0000 10000000:01000000:0.0:1788940571.742599:0:5813:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788940571.742602:0:5813:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788940571.742606:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f4118288000 10000000:01000000:0.0:1788940571.742610:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788940571.742618:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f4118288000 from 1 10000000:01000000:0.0:1788940571.742632:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788940571.742674:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: 00000000aec18225/0xa1d8aa9164aa29a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940571.742684:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: 00000000aec18225/0xa1d8aa9164aa29a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940571.742693:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: 00000000aec18225/0xa1d8aa9164aa29a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940571.742710:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9c5c4b8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068485504:0@lo:101: 00000100:00100000:0.0:1788940571.742780:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940571.742838:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a31db050 going to sleep for 11 seconds 00000100:00100000:2.0:1788940571.743015:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068485504 00000100:00100000:2.0:1788940571.743022:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068485504 00000100:00100000:2.0:1788940571.743071:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940571.743080:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e18562b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+5:5813:x1875840068485504:12345-0@lo:101: 00010000:00010000:2.0:1788940571.743093:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940571.743107:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b8783c40/0xa1d8aa9164aa29a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa29a1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.743129:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b8783c40/0xa1d8aa9164aa29a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa29a1 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.743139:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b8783c40/0xa1d8aa9164aa29a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa29a1 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.743148:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b8783c40, rc 0) 00000100:00100000:2.0:1788940571.743211:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e18562b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+6:5813:x1875840068485504:12345-0@lo:101: Request processed in 134us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940571.743216:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940571.743349:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9c5c4b8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068485504:0@lo:101: 00010000:00010000:0.0:1788940571.743371:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: 00000000aec18225/0xa1d8aa9164aa29a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa29a8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940571.743379:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: 00000000aec18225/0xa1d8aa9164aa29a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa29a8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940571.743428:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c9c5c4b8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068485632:0@lo:501: 00000100:00100000:0.0:1788940571.743457:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940571.743486:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a31db050 going to sleep for 11 seconds 00000100:00100000:2.0:1788940571.743597:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068485632 00000100:00100000:2.0:1788940571.743602:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068485632 00000100:00100000:2.0:1788940571.743641:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940571.743653:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e580780a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+6:5813:x1875840068485632:12345-0@lo:501: 00000100:00100000:2.0:1788940571.743903:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e580780a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+6:5813:x1875840068485632:12345-0@lo:501: Request processed in 251us (445us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940571.743910:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940571.743940:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c9c5c4b8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068485632:0@lo:501: 10000000:01000000:2.0:1788940571.743966:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788940571.743977:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: 00000000aec18225/0xa1d8aa9164aa29a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa29a8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.743984:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: 00000000aec18225/0xa1d8aa9164aa29a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa29a8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940571.743992:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f411876b000 10000000:01000000:2.0:1788940571.743996:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788940571.744000:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f411876b000 10000000:01000000:2.0:1788940571.744002:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788940571.744005:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f411876b000 from 1 10000000:01000000:2.0:1788940571.744007:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788940571.744024:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: 000000007d459f59/0xa1d8aa9164aa29af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.744030:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: 000000007d459f59/0xa1d8aa9164aa29af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.744036:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: 000000007d459f59/0xa1d8aa9164aa29af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940571.744046:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b9b502f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068485760:0@lo:101: 00000100:00100000:2.0:1788940571.744071:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940571.744093:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ebc83e79 going to sleep for 11 seconds 00000100:00100000:2.0:1788940571.744116:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068485760 00000100:00100000:2.0:1788940571.744120:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068485760 00000100:00100000:2.0:1788940571.744141:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940571.744145:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fcf80cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+6:5813:x1875840068485760:12345-0@lo:101: 00010000:00010000:2.0:1788940571.744152:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940571.744163:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000bf4c593/0xa1d8aa9164aa29b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa29af expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.744177:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000bf4c593/0xa1d8aa9164aa29b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa29af expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.744213:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000bf4c593/0xa1d8aa9164aa29b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa29af expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.744220:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000bf4c593, rc 0) 00000100:00100000:2.0:1788940571.744248:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fcf80cf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+7:5813:x1875840068485760:12345-0@lo:101: Request processed in 102us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940571.744253:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940571.744298:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b9b502f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068485760:0@lo:101: 00010000:00010000:2.0:1788940571.744307:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: 000000007d459f59/0xa1d8aa9164aa29af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.744315:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: 000000007d459f59/0xa1d8aa9164aa29af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940571.744327:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788940571.744333:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: 000000007d459f59/0xa1d8aa9164aa29af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.744348:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: 000000007d459f59/0xa1d8aa9164aa29af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940571.744354:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788940571.744356:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788940571.744360:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f411876b000 10000000:01000000:2.0:1788940571.744363:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788940571.744366:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788940571.744367:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788940571.744380:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: 000000006a1da6d4/0xa1d8aa9164aa29bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.744386:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: 000000006a1da6d4/0xa1d8aa9164aa29bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.744392:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: 000000006a1da6d4/0xa1d8aa9164aa29bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940571.744402:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b9b502f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068485888:0@lo:101: 00000100:00100000:2.0:1788940571.744427:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940571.744446:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ebc83e79 going to sleep for 11 seconds 00000100:00100000:2.0:1788940571.744463:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068485888 00000100:00100000:2.0:1788940571.744466:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068485888 00000100:00100000:2.0:1788940571.744487:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940571.744493:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003108c1ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+7:5813:x1875840068485888:12345-0@lo:101: 00010000:00010000:2.0:1788940571.744499:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940571.744718:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000536a6f48/0xa1d8aa9164aa29c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa29bd expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.744749:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000536a6f48/0xa1d8aa9164aa29c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa29bd expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.744757:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000536a6f48/0xa1d8aa9164aa29c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa29bd expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940571.744763:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000536a6f48, rc 0) 00000100:00100000:2.0:1788940571.744880:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003108c1ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+8:5813:x1875840068485888:12345-0@lo:101: Request processed in 387us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940571.744886:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940571.745036:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b9b502f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068485888:0@lo:101: 00010000:00010000:3.0:1788940571.745047:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: 000000006a1da6d4/0xa1d8aa9164aa29bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa29c4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940571.745053:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: 000000006a1da6d4/0xa1d8aa9164aa29bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa29c4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940571.745106:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f3422b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068486016:0@lo:501: 00000100:00100000:3.0:1788940571.745132:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940571.745217:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f70ae59e going to sleep for 11 seconds 00000100:00100000:2.0:1788940571.745314:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068486016 00000100:00100000:2.0:1788940571.745319:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068486016 00000100:00100000:2.0:1788940571.745385:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940571.745392:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003ec396b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+8:5813:x1875840068486016:12345-0@lo:501: 00000100:00100000:2.0:1788940571.745786:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003ec396b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+9:5813:x1875840068486016:12345-0@lo:501: Request processed in 394us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940571.745793:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940571.745887:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f3422b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068486016:0@lo:501: 00000100:00100000:3.0:1788940571.745913:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f3422b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068486144:0@lo:503: 00000100:00100000:3.0:1788940571.745953:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940571.746670:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f70ae59e going to sleep for 11 seconds 00000100:00100000:0.0:1788940571.747067:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068486144 00000100:00100000:0.0:1788940571.747075:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068486144 00000100:00100000:0.0:1788940571.747112:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940571.747119:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c8804386 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+9:5813:x1875840068486144:12345-0@lo:503: 00000100:00100000:0.0:1788940571.747406:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c8804386 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+9:5813:x1875840068486144:12345-0@lo:503: Request processed in 286us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940571.747414:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940571.747759:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f3422b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068486144:0@lo:503: 00000100:00100000:2.0:1788940571.748404:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4dfa3b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5856:1875840068486272:0@lo:502: 00000100:00100000:2.0:1788940571.748456:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940571.748598:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set 000000008aded473 going to sleep for 11 seconds 00000100:00100000:0.0:1788940571.748694:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068486272 00000100:00100000:0.0:1788940571.748701:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068486272 00000100:00100000:0.0:1788940571.748771:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940571.748780:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000086704140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+9:5856:x1875840068486272:12345-0@lo:502: 00000100:00100000:0.0:1788940571.748972:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000086704140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+9:5856:x1875840068486272:12345-0@lo:502: Request processed in 193us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940571.748979:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940571.749056:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4dfa3b3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5856:1875840068486272:0@lo:502: 00000020:01000000:3.0:1788940571.749089:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940571.749100:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940571.749102:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788940571.749107:0:5856:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788940571.749110:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940571.749122:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009b843615) 00000020:00000080:3.0:1788940571.749141:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788940571.749146:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788940571.749256:0:5856:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788940571.749264:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa1d8aa9164aa29d2 00000020:00000080:3.0:1788940571.749576:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788940571.749582:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940571.749586:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940571.749587:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788940571.749589:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940571.749592:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940571.749594:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788940571.749597:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940571.749603:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000006322201c) 00000020:00000080:3.0:1788940571.749613:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788940571.749617:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788940571.749618:0:5856:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788940571.749632:0:5856:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788940571.749640:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788940571.749681:0:5856:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000033a47953 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788940571.749701:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000019bc58ef) 00000020:00000080:3.0:1788940571.749709:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788940571.749772:0:5856:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788940571.749778:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa1d8aa9164aa29e7 00000020:00000080:3.0:1788940571.749867:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788940571.749872:0:5856:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788940571.749877:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa1d8aa9164aa29ee 00080000:01000000:3.0:1788940571.749881:0:5856:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788940571.749889:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa1d8aa9164aa29f5 00080000:10000000:3.0:1788940571.750339:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788940571.750545:0:5856:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788940571.754814:0:5856:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788940571.819321:0:5856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788940571.819903:0:5856:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788940571.822164:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788940571.822470:0:5856:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788940571.860100:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000fafcbf2d) 00000020:00000080:3.0:1788940571.860124:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788940571.860221:0:5856:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788940571.860228:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa1d8aa9164aa2a03 00000020:00000080:3.0:1788940571.861011:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788940571.864776:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940571.904446:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940571.933813:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940571.973433:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788940572.034826:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940572.092953:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788940572.144363:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa1d8aa9164aa2a0a 00000020:00000080:1.0:1788940572.145066:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788940572.145078:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940572.145085:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940572.145087:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788940572.145090:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940572.145096:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940572.145097:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788940572.145100:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788940572.145217:0:5856:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788940572.145234:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940572.145238:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940572.145239:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788940572.145241:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940572.145243:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940572.145244:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788940572.145246:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788940572.145248:0:5856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788940572.145320:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f2249704 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5856:1875840068486400:0@lo:502: 00000100:00100000:1.0:1788940572.145419:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940572.145526:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f17ab689 going to sleep for 11 seconds 00000100:00100000:2.0:1788940572.145601:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068486400 00000100:00100000:2.0:1788940572.145610:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068486400 00000100:00100000:2.0:1788940572.145940:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940572.145950:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000005471dc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+9:5856:x1875840068486400:12345-0@lo:502: 00000100:00100000:2.0:1788940572.146433:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000005471dc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+9:5856:x1875840068486400:12345-0@lo:502: Request processed in 483us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940572.146441:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940572.146562:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f2249704 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5856:1875840068486400:0@lo:502: 00000020:01000000:1.0:1788940572.146598:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940572.146606:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940572.146608:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788940572.146845:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788940572.147079:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788940572.147103:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788940572.147134:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: 000000006a1da6d4/0xa1d8aa9164aa29bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa29c4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.147155:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: 000000006a1da6d4/0xa1d8aa9164aa29bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa29c4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940572.147163:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f411876b000 from 1 10000000:01000000:0.0:1788940572.147166:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788940572.147226:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.147234:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.147243:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940572.147259:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068486528:0@lo:101: 00000100:00100000:0.0:1788940572.147317:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940572.147987:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ee476f2 going to sleep for 11 seconds 00000100:00100000:3.0:1788940572.148079:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068486528 00000100:00100000:3.0:1788940572.148087:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068486528 00000100:00100000:3.0:1788940572.148119:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788940572.148138:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000787d51bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+9:5813:x1875840068486528:12345-0@lo:101: 00010000:00010000:3.0:1788940572.148150:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940572.148167:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c8e338b9/0xa1d8aa9164aa2a18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2a11 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940572.148211:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c8e338b9/0xa1d8aa9164aa2a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a11 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940572.148222:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c8e338b9/0xa1d8aa9164aa2a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a11 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940572.148231:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c8e338b9, rc 0) 00000100:00100000:3.0:1788940572.148287:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000787d51bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+10:5813:x1875840068486528:12345-0@lo:101: Request processed in 149us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940572.148292:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940572.148430:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068486528:0@lo:101: 00010000:00010000:0.0:1788940572.148442:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.148449:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2a18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940572.149034:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068486656:0@lo:256: 00000100:00100000:0.0:1788940572.149081:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940572.149116:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ee476f2 going to sleep for 11 seconds 00000100:00100000:3.0:1788940572.149533:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068486656 00000100:00100000:3.0:1788940572.149541:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068486656 00000100:00100000:3.0:1788940572.149582:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788940572.149588:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a93d8769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+10:5813:x1875840068486656:12345-0@lo:256: 20000000:01000000:3.0:1788940572.149607:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788940572.149626:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788940572.149712:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a93d8769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+10:5813:x1875840068486656:12345-0@lo:256: Request processed in 123us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940572.149720:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940572.149897:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068486656:0@lo:256: 10000000:01000000:0.0:1788940572.150598:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788940572.150633:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.150646:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940572.150656:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f411876b000 from 1 10000000:01000000:0.0:1788940572.150658:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940572.150690:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.150697:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.150705:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940572.150719:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068486784:0@lo:101: 00000100:00100000:0.0:1788940572.150757:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940572.150781:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ee476f2 going to sleep for 11 seconds 00000100:00100000:3.0:1788940572.151065:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068486784 00000100:00100000:3.0:1788940572.151072:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068486784 00000100:00100000:3.0:1788940572.151103:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788940572.151109:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000b2214ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+10:5813:x1875840068486784:12345-0@lo:101: 00010000:00010000:3.0:1788940572.151134:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940572.151145:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004ef92be9/0xa1d8aa9164aa2a26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2a1f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940572.151167:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ef92be9/0xa1d8aa9164aa2a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a1f expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940572.151175:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004ef92be9/0xa1d8aa9164aa2a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a1f expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940572.151182:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004ef92be9, rc 0) 00000100:00100000:3.0:1788940572.151237:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000b2214ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:5813:x1875840068486784:12345-0@lo:101: Request processed in 128us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940572.151243:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940572.151374:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068486784:0@lo:101: 00010000:00010000:0.0:1788940572.151386:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.151394:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2a26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940572.151469:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068486912:0@lo:501: 00000100:00100000:0.0:1788940572.151498:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940572.151532:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ee476f2 going to sleep for 11 seconds 00000100:00100000:3.0:1788940572.151638:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068486912 00000100:00100000:3.0:1788940572.151642:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068486912 00000100:00100000:3.0:1788940572.151658:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940572.151662:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b097667a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:5813:x1875840068486912:12345-0@lo:501: 00000100:00100000:3.0:1788940572.154597:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b097667a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:5813:x1875840068486912:12345-0@lo:501: Request processed in 2922us (3088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940572.154793:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940572.155139:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068486912:0@lo:501: 00000100:00100000:0.0:1788940572.155223:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068487040:0@lo:503: 00000100:00100000:0.0:1788940572.155294:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940572.155323:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ee476f2 going to sleep for 11 seconds 00000100:00100000:3.0:1788940572.155458:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068487040 00000100:00100000:3.0:1788940572.155465:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068487040 00000100:00100000:3.0:1788940572.155511:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940572.155519:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000de3bef94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:5813:x1875840068487040:12345-0@lo:503: 00000040:00080000:3.0:1788940572.155570:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788940572.155610:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000de3bef94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:5813:x1875840068487040:12345-0@lo:503: Request processed in 91us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940572.155630:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788940572.156239:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068487040:0@lo:503: 00000040:00080000:0.0:1788940572.157442:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788940572.157850:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788940572.157886:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940572.157909:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940572.157921:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940572.157966:0:5813:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788940572.157969:0:5813:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f411876b000 10000000:01000000:3.0:1788940572.157971:0:5813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f411876b000 10000000:01000000:3.0:1788940572.157975:0:5813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788940572.157980:0:5813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f411876b000 from 1 10000000:01000000:3.0:1788940572.157983:0:5813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788940572.158015:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: 00000000a31a6b75/0xa1d8aa9164aa2a2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940572.158023:0:5813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: 00000000a31a6b75/0xa1d8aa9164aa2a2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940572.158045:0:5813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: 00000000a31a6b75/0xa1d8aa9164aa2a2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940572.158061:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f3422b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068487168:0@lo:101: 00000100:00100000:3.0:1788940572.158120:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940572.159388:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a7c54be5 going to sleep for 11 seconds 00000100:00100000:1.0:1788940572.159489:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068487168 00000100:00100000:1.0:1788940572.159509:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068487168 00000100:00100000:2.0:1788940572.159734:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940572.159745:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fbd2b50e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:5813:x1875840068487168:12345-0@lo:101: 00010000:00010000:2.0:1788940572.159763:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940572.159782:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ea7557eb/0xa1d8aa9164aa2a34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2a2d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940572.159809:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea7557eb/0xa1d8aa9164aa2a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a2d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940572.159819:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ea7557eb/0xa1d8aa9164aa2a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a2d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940572.159828:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ea7557eb, rc 0) 00000100:00100000:2.0:1788940572.159892:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fbd2b50e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5813:x1875840068487168:12345-0@lo:101: Request processed in 149us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940572.159899:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940572.159998:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f3422b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068487168:0@lo:101: 00010000:00010000:3.0:1788940572.160015:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: 00000000a31a6b75/0xa1d8aa9164aa2a2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a34 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940572.160024:0:5813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: 00000000a31a6b75/0xa1d8aa9164aa2a2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2a34 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940572.160085:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f3422b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068487296:0@lo:501: 00000100:00100000:3.0:1788940572.160118:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940572.160227:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a7c54be5 going to sleep for 11 seconds 00000100:00100000:2.0:1788940572.160336:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068487296 00000100:00100000:2.0:1788940572.160340:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068487296 00000100:00100000:2.0:1788940572.160371:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940572.160377:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000033ed0a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5813:x1875840068487296:12345-0@lo:501: 00000100:00100000:2.0:1788940572.160907:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000033ed0a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5813:x1875840068487296:12345-0@lo:501: Request processed in 530us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940572.160924:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788940572.161483:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f3422b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068487296:0@lo:501: 00000100:00100000:3.0:1788940572.161847:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f3422b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068487424:0@lo:503: 00000100:00100000:3.0:1788940572.161899:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940572.161935:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a7c54be5 going to sleep for 11 seconds 00000100:00100000:2.0:1788940572.161995:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068487424 00000100:00100000:2.0:1788940572.162002:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068487424 00000100:00100000:2.0:1788940572.162044:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940572.162051:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c64f1dfd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5813:x1875840068487424:12345-0@lo:503: 00000100:00100000:2.0:1788940572.162423:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c64f1dfd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5813:x1875840068487424:12345-0@lo:503: Request processed in 372us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940572.162440:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788940572.162880:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f3422b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068487424:0@lo:503: 00000100:00100000:3.0:1788940572.165912:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008f3422b0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5861:1875840068487552:0@lo:502: 00000100:00100000:3.0:1788940572.166005:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940572.166095:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9db94c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940572.166365:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068487552 00000100:00100000:2.0:1788940572.166374:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068487552 00000100:00100000:2.0:1788940572.167063:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940572.167078:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b90f8fff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5861:x1875840068487552:12345-0@lo:502: 00000100:00100000:2.0:1788940572.167971:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b90f8fff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5861:x1875840068487552:12345-0@lo:502: Request processed in 895us (1964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940572.167982:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788940572.168398:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008f3422b0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5861:1875840068487552:0@lo:502: 00000020:01000004:3.0:1788940572.168475:0:5861:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788940572.168491:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000009aaf32c0) 00000020:00000080:3.0:1788940572.168589:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788940572.168805:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000033a47953 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788940572.168810:0:5861:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000033a47953 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788940572.168812:0:5861:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000033a47953 4 00010000:00080000:3.0:1788940572.168846:0:5861:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005fdcfc4e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.117@tcp at head 00010000:00010000:2.0:1788940572.175086:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788940572.175390:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788940572.175425:0:5861:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788940572.175445:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa1d8aa9164aa2a42 00000100:00080000:2.0:1788940572.175454:0:5861:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788940572.175464:0:5861:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005fdcfc4e using connection 192.168.202.117@tcp/0@lo 00000100:00100000:2.0:1788940572.175790:0:5861:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000670d3e73 x1875840068487680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940572.175866:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000670d3e73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875840068487680:0@lo:38: 00000100:00100000:3.0:1788940572.175943:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788940572.176013:0:5861:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788940572.176517:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5861:1875840068487808:0@lo:502: 00000100:00100000:0.0:1788940572.176566:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940572.176596:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068487808 00000100:00100000:0.0:1788940572.176603:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068487808 00000100:00100000:0.0:1788940572.176837:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940572.176846:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9ff67a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5861:x1875840068487808:12345-0@lo:502: 00000100:00100000:0.0:1788940572.177107:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9ff67a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5861:x1875840068487808:12345-0@lo:502: Request processed in 261us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940572.177114:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940572.177293:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063f1a6b6 going to sleep for 11 seconds 00000100:00100000:0.0:1788940572.177319:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5861:1875840068487808:0@lo:502: 00000040:00080000:0.0:1788940572.177346:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788940572.177402:0:5813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788940572.177435:0:5813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940572.177448:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: 00000000a31a6b75/0xa1d8aa9164aa2a2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a34 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.177468:0:5813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: 00000000a31a6b75/0xa1d8aa9164aa2a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a34 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788940572.177586:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788940572.177589:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788940572.177590:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940572.177591:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940572.177593:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940572.177594:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940572.177596:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788940572.177597:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788940572.177599:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788940572.177600:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788940572.177602:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940572.177603:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940572.177607:0:5813:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788940572.177610:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788940572.177736:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788940572.177737:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940572.177738:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940572.177740:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940572.177741:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940572.177742:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788940572.177743:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788940572.177744:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788940572.177745:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788940572.177747:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940572.177748:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940572.177765:0:5813:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788940572.177776:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068487936:0@lo:253: 00000100:00100000:0.0:1788940572.177814:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940572.177831:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set 0000000063f1a6b6 going to sleep for 11 seconds 00000100:00100000:2.0:1788940572.178095:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068487936 00000100:00100000:2.0:1788940572.178101:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068487936 00000100:00100000:2.0:1788940572.178233:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788940572.178241:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ed369be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5813:x1875840068487936:12345-0@lo:253: 20000000:01000000:2.0:1788940572.178275:0:5827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788940572.178290:0:5827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788940572.179401:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068487680 00000100:00100000:3.0:1788940572.179410:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068487680 00000100:00100000:3.0:1788940572.179449:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940572.179455:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f3422b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1875840068487680:12345-0@lo:38: 00000100:00100000:3.0:1788940572.179594:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f3422b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1875840068487680:12345-0@lo:38: Request processed in 138us (3650us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788940572.179602:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940572.179794:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788940572.179802:0:3300:0:(import.c:65:import_set_state_nolock()) 000000005fdcfc4e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940572.179806:0:3300:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788940572.179810:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000670d3e73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875840068487680:0@lo:38: 00010000:00010000:2.0:1788940572.233417:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788940572.249609:0:5827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788940572.249742:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788940572.249973:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788940572.249979:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788940572.250001:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.250019:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c8e338b9/0xa1d8aa9164aa2a18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a11 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.250027:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.250066:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c8e338b9/0xa1d8aa9164aa2a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2a11 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.250082:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c8e338b9/0xa1d8aa9164aa2a18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a11 expref: 12 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940572.250096:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f2249704 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875840068488064:0@lo:104: 00000100:00100000:1.0:1788940572.250327:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940572.250845:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f17ab689 going to sleep for 11 seconds 00000100:00100000:0.0:1788940572.254061:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068488064 00000100:00100000:0.0:1788940572.254089:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068488064 00000100:00100000:0.0:1788940572.254152:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940572.254161:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007196ae9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:5849:x1875840068488064:12345-0@lo:104: 00010000:00010000:0.0:1788940572.254180:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2a18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.254304:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940572.254310:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007196ae9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:5849:x1875840068488064:12345-0@lo:104: Request processed in 151us (3983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940572.254316:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788940572.254338:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940572.254343:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2a18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.254350:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b594054b already unused, calling callback (00000000ad8f27a2) 10000000:00010000:0.0:1788940572.254354:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2a18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.254362:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2a18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940572.254368:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2a18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940572.254373:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940572.254411:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.254418:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940572.254433:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.254447:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: 00000000b594054b/0xa1d8aa9164aa2a11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a18 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940572.254463:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940572.254465:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940572.254466:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940572.254570:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009147d338 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068488192:0@lo:103: 00000100:00100000:0.0:1788940572.254609:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940572.254995:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f2249704 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875840068488064:0@lo:104: 00010000:00010000:1.0:1788940572.255026:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940572.255219:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068488192 00000100:00100000:1.0:1788940572.255225:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068488192 00010000:00010000:1.0:1788940572.255244:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c8e338b9/0xa1d8aa9164aa2a18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a11 expref: 13 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940572.255282:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940572.255289:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000692e2c2e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:3302:x1875840068488192:12345-0@lo:103: 00010000:00010000:1.0:1788940572.255301:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940572.255305:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c8e338b9/0xa1d8aa9164aa2a18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a11 expref: 13 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.255314:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c8e338b9/0xa1d8aa9164aa2a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a11 expref: 13 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.255328:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c8e338b9/0xa1d8aa9164aa2a18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a11 expref: 13 pid: 5827 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.255342:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.255349:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788940572.255361:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005382423s 00010000:00010000:1.0:1788940572.255365:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.255370:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.255383:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.255388:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.255393:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004c281b4e already unused, calling callback (000000009b6825e3) 00010000:00010000:1.0:1788940572.255396:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.255402:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.255415:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.255424:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940572.255458:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000692e2c2e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:3302:x1875840068488192:12345-0@lo:103: Request processed in 171us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940572.255464:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940572.255491:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009147d338 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068488192:0@lo:103: 00010000:00010000:1.0:1788940572.255522:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.255529:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940572.255534:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004c281b4e/0xa1d8aa9164aa2a49 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940572.264926:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ed369be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:5813:x1875840068487936:12345-0@lo:253: Request processed in 86676us (87102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940572.264943:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940572.265036:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5813:1875840068487936:0@lo:253: 10000000:01000000:0.0:1788940572.265055:0:5813:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788940572.265058:0:5813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940572.265061:0:5813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788940572.265062:0:5813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940572.265064:0:5813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940572.265065:0:5813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940572.265067:0:5813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940572.265068:0:5813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788940572.265070:0:5813:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788940572.265071:0:5813:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788940572.265072:0:5813:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788940572.265074:0:5813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940572.265075:0:5813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788940572.265089:0:5813:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788940572.273955:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940572.275074:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940572.275785:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940572.276056:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940572.276965:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940572.277331:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940572.279095:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940572.279451:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940572.280068:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940572.280487:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940572.280998:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940572.281316:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788940572.381896:0:5813:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788940572.422809:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788940572.423091:0:5867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788940572.425959:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788940572.426092:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788940572.426613:0:5813:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788940572.426620:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788940572.426731:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1788940572.429722:0:5866:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788940572.429733:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:2.0:1788940572.437211:0:5813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788940572.443496:0:5813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788940572.443581:0:5813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788940572.444440:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788940572.446925:0:5813:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788940572.448566:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788940572.448705:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788940572.448844:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788940572.449002:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788940572.449129:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788940572.449288:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788940572.449449:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788940572.449587:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788940572.449762:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788940572.449911:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788940572.450087:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788940572.450283:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788940572.450418:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788940572.450541:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788940572.450691:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788940572.450824:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788940572.451114:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788940572.452275:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788940572.452466:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788940572.453234:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788940572.453400:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788940572.453553:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788940572.453900:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788940572.454044:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788940572.454274:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788940572.454432:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788940572.454757:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788940572.454928:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788940572.455082:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788940572.455250:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788940572.455429:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788940572.456009:0:5813:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788940572.456247:0:5813:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788940572.481350:0:5867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940572.542069:0:5867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788940572.542182:0:5867:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788940572.542228:0:5867:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1788940572.543889:0:5813:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788940572.543931:0:5813:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0d581d7b988 00100000:10000000:2.0:1788940572.543941:0:5813:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788940572.545066:0:5813:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788940572.545084:0:5813:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.117@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788940572.545339:0:5813:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788940572.545373:0:5813:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788940573.257456:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940574.280970:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940575.305770:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940576.329144:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788940577.288370:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788940577.288381:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788940577.288392:0:38:0:(import.c:65:import_set_state_nolock()) 000000005fdcfc4e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940577.288412:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005fdcfc4e using connection 192.168.202.117@tcp/0@lo 00000100:00100000:3.0:1788940577.288435:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cdd75377 x1875840068488448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940577.288524:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940577.288536:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b73fa8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068488320:0@lo:400: 00000100:00100000:3.0:1788940577.288766:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940577.289003:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cdd75377 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875840068488448:0@lo:38: 00000100:00100000:3.0:1788940577.289037:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940577.289241:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068488320 00000100:00100000:0.0:1788940577.289250:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068488320 00000100:00100000:0.0:1788940577.289292:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940577.289308:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000878b27fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:3304:x1875840068488320:12345-0@lo:400: 00000100:00100000:0.0:1788940577.289356:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000878b27fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:3304:x1875840068488320:12345-0@lo:400: Request processed in 49us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940577.289364:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940577.289400:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068488448 00000100:00100000:0.0:1788940577.289404:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068488448 00000100:00100000:0.0:1788940577.289423:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940577.289427:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cc7cc0cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3300:x1875840068488448:12345-0@lo:38: 00010000:00080000:0.0:1788940577.289447:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1788940577.289480:0:5835:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa1d8aa9164aa2a50 00000004:00100000:0.0:1788940577.289528:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788940577.289731:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000f128db4f : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940577.290002:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cc7cc0cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875840068488448:12345-0@lo:38: Request processed in 573us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940577.290010:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788940577.290344:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cdd75377 x1875840068488448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788940577.290360:0:3300:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788940577.290368:0:3300:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788940577.290372:0:3300:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788940577.290374:0:3300:0:(import.c:65:import_set_state_nolock()) 000000005fdcfc4e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788940577.290379:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cdd75377 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875840068488448:0@lo:38: 00000100:00100000:3.0:1788940577.290410:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b73fa8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068488320:0@lo:400: 00010000:00010000:0.0:1788940577.353168:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788940577.803069:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788940577.803083:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f411876b000 from 3 10000000:01000000:3.0:1788940577.803088:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788940577.803136:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: 0000000041660e40/0xa1d8aa9164aa2a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940577.803148:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: 0000000041660e40/0xa1d8aa9164aa2a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940577.803159:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: 0000000041660e40/0xa1d8aa9164aa2a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940577.803240:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b73fa8b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068488576:0@lo:101: 00000100:00100000:3.0:1788940577.803308:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940577.803355:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037316947 going to sleep for 11 seconds 00000100:00100000:1.0:1788940577.803540:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068488576 00000100:00100000:1.0:1788940577.803548:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068488576 00000100:00100000:1.0:1788940577.803594:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788940577.803677:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b211f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:5830:x1875840068488576:12345-0@lo:101: 00010000:00010000:1.0:1788940577.803701:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940577.803715:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000044a1737d/0xa1d8aa9164aa2a5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2a57 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940577.803737:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044a1737d/0xa1d8aa9164aa2a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a57 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940577.803759:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000044a1737d/0xa1d8aa9164aa2a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a57 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940577.803768:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000044a1737d, rc 0) 00000100:00100000:1.0:1788940577.803807:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b211f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5830:x1875840068488576:12345-0@lo:101: Request processed in 134us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940577.803814:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940577.804413:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b73fa8b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068488576:0@lo:101: 00010000:00010000:3.0:1788940577.804431:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: 0000000041660e40/0xa1d8aa9164aa2a57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a5e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940577.804439:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: 0000000041660e40/0xa1d8aa9164aa2a57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2a5e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940577.804493:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b73fa8b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068488704:0@lo:256: 00000100:00100000:3.0:1788940577.804529:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940577.804553:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037316947 going to sleep for 11 seconds 00000100:00100000:3.0:1788940577.804569:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068488704 00000100:00100000:3.0:1788940577.804574:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068488704 00000100:00100000:3.0:1788940577.806874:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940577.806892:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a4cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5830:x1875840068488704:12345-0@lo:256: 20000000:01000000:3.0:1788940577.806919:0:5826:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788940577.807015:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788940577.807019:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788940577.807788:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a4cecbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5830:x1875840068488704:12345-0@lo:256: Request processed in 899us (3255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940577.807799:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788940577.812319:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b73fa8b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068488704:0@lo:256: 10000000:01000000:0.0:1788940577.812387:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788940577.812396:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: 0000000041660e40/0xa1d8aa9164aa2a57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a5e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940577.812406:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: 0000000041660e40/0xa1d8aa9164aa2a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a5e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940578.378700:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788940578.494793:0:6110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg217-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788940579.405839:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940580.425296:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940581.448579:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940582.408509:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940582.408543:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002427907c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068488960:0@lo:400: 00000100:00100000:3.0:1788940582.408618:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940582.408841:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068488960 00000100:00100000:3.0:1788940582.408863:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068488960 00000100:00100000:3.0:1788940582.408917:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940582.408926:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ffcf8569 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068488960:12345-0@lo:400: 00000100:00100000:3.0:1788940582.408984:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ffcf8569 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068488960:12345-0@lo:400: Request processed in 60us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940582.408991:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788940582.409038:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002427907c x1875840068488960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940582.409054:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002427907c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068488960:0@lo:400: 00000100:00100000:2.0:1788940582.409214:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940582.409226:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cdd75377 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068488832:0@lo:400: 00000100:00100000:2.0:1788940582.409265:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940582.412113:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068488832 00000100:00100000:3.0:1788940582.412139:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068488832 00000100:00100000:3.0:1788940582.412276:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940582.412286:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d4139ce3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:3303:x1875840068488832:12345-0@lo:400: 00000100:00100000:3.0:1788940582.412399:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d4139ce3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:3303:x1875840068488832:12345-0@lo:400: Request processed in 115us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940582.412406:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788940582.412539:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cdd75377 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068488832:0@lo:400: 00010000:00010000:1.0:1788940582.472595:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940583.499091:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788940584.415381:0:6311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdafe8c590 20000000:00000080:3.0:1788940584.415402:0:6311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f4134a20400 uarg=0000000000000000 20000000:01000000:3.0:1788940584.415436:0:6311:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788940584.415443:0:6311:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788940584.415448:0:6311:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788940584.415654:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788940584.415666:0:6311:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788940584.422958:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788940584.423280:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788940584.423336:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788940584.423382:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788940584.423405:0:6311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788940584.423421:0:6311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940584.423440:0:6311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004ef92be9/0xa1d8aa9164aa2a26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a1f expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940584.423447:0:6311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940584.423487:0:6311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004ef92be9/0xa1d8aa9164aa2a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2a1f expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940584.423501:0:6311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004ef92be9/0xa1d8aa9164aa2a26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a1f expref: 11 pid: 5827 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940584.423513:0:6311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002427907c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1875840068489088:0@lo:104: 00000100:00100000:3.0:1788940584.423571:0:6311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940584.423622:0:6311:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9db94c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940584.423827:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068489088 00000100:00100000:1.0:1788940584.423837:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068489088 00000100:00100000:1.0:1788940584.423889:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940584.423898:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003acebd67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:6311:x1875840068489088:12345-0@lo:104: 00010000:00010000:1.0:1788940584.423909:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2a26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.423960:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940584.423965:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003acebd67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:6311:x1875840068489088:12345-0@lo:104: Request processed in 69us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940584.423971:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788940584.423990:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940584.423995:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2a26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424002:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee82f19b already unused, calling callback (00000000ad8f27a2) 10000000:00010000:1.0:1788940584.424004:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2a26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424019:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2a26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940584.424025:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2a26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940584.424031:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940584.424056:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424063:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940584.424080:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424087:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: 00000000ee82f19b/0xa1d8aa9164aa2a1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a26 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424105:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940584.424107:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940584.424108:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940584.424119:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f2249704 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068489216:0@lo:103: 00000100:00100000:1.0:1788940584.424147:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940584.424218:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068489216 00000100:00100000:1.0:1788940584.424222:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068489216 00010000:00010000:1.0:1788940584.424238:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004ef92be9/0xa1d8aa9164aa2a26 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a1f expref: 12 pid: 5827 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940584.424257:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940584.424263:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f0fb1b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:3302:x1875840068489216:12345-0@lo:103: 00010000:00010000:1.0:1788940584.424279:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940584.424283:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004ef92be9/0xa1d8aa9164aa2a26 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a1f expref: 12 pid: 5827 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424292:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004ef92be9/0xa1d8aa9164aa2a26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a1f expref: 12 pid: 5827 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424305:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424311:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424322:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424328:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424334:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424340:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424344:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a5877670 already unused, calling callback (000000009b6825e3) 00010000:00010000:1.0:1788940584.424347:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424353:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424369:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940584.424378:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940584.424402:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f0fb1b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:3302:x1875840068489216:12345-0@lo:103: Request processed in 140us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940584.424409:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940584.424438:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f2249704 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068489216:0@lo:103: 00010000:00010000:3.0:1788940584.428754:0:6311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004ef92be9/0xa1d8aa9164aa2a26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a1f expref: 11 pid: 5827 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940584.428776:0:6311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002427907c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1875840068489088:0@lo:104: 00010000:00010000:3.0:1788940584.428799:0:6311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940584.428809:0:6311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940584.428816:0:6311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940584.428840:0:6311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a65 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940584.521714:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940585.544716:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940586.568640:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940587.529714:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000062fb1a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068489472:0@lo:400: 00000100:00100000:3.0:1788940587.529824:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940587.529904:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940587.529910:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068489344:0@lo:400: 00000100:00100000:3.0:1788940587.529943:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940587.529988:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068489344 00000100:00100000:3.0:1788940587.529999:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068489344 00000100:00100000:3.0:1788940587.530062:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940587.530072:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000069a951af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:3304:x1875840068489344:12345-0@lo:400: 00000100:00100000:3.0:1788940587.530143:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000069a951af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:3304:x1875840068489344:12345-0@lo:400: Request processed in 73us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940587.530153:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940587.530245:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7f31915 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068489344:0@lo:400: 00000100:00100000:0.0:1788940587.530623:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068489472 00000100:00100000:0.0:1788940587.530628:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068489472 00000100:00100000:0.0:1788940587.530674:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940587.530681:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002427907c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068489472:12345-0@lo:400: 00000100:00100000:0.0:1788940587.530731:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002427907c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068489472:12345-0@lo:400: Request processed in 51us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940587.530738:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788940587.530816:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000062fb1a80 x1875840068489472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940587.530830:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000062fb1a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068489472:0@lo:400: 00010000:00010000:2.0:1788940587.595388:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788940587.792414:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788940587.792426:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f411876b000 from 1 10000000:01000000:0.0:1788940587.792432:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940587.792506:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: 000000003a25eeab/0xa1d8aa9164aa2a6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940587.792521:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: 000000003a25eeab/0xa1d8aa9164aa2a6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940587.792534:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: 000000003a25eeab/0xa1d8aa9164aa2a6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940587.792564:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007852d271 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068489600:0@lo:101: 00000100:00100000:0.0:1788940587.792673:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940587.792741:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c745f6f going to sleep for 11 seconds 00000100:00100000:3.0:1788940587.792886:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068489600 00000100:00100000:3.0:1788940587.792896:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068489600 00000100:00100000:3.0:1788940587.792963:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940587.792973:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d9a20c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:5830:x1875840068489600:12345-0@lo:101: 00010000:00010000:3.0:1788940587.792990:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940587.793006:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2a6c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940587.793051:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a6c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940587.793064:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a5877670/0xa1d8aa9164aa2a73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a6c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940587.793074:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a5877670, rc 0) 00000100:00100000:3.0:1788940587.793138:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d9a20c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5830:x1875840068489600:12345-0@lo:101: Request processed in 166us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940587.793144:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940587.793388:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007852d271 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068489600:0@lo:101: 00010000:00010000:2.0:1788940587.793406:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: 000000003a25eeab/0xa1d8aa9164aa2a6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a73 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940587.793416:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: 000000003a25eeab/0xa1d8aa9164aa2a6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2a73 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940587.793493:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f981b0dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068489728:0@lo:501: 00000100:00100000:2.0:1788940587.793523:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940587.793549:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000002d4b9e going to sleep for 11 seconds 00000100:00100000:0.0:1788940587.793799:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068489728 00000100:00100000:0.0:1788940587.793805:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068489728 00000100:00100000:0.0:1788940587.793845:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788940587.793852:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000048e3db8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5830:x1875840068489728:12345-0@lo:501: 00000100:00100000:0.0:1788940587.794183:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000048e3db8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5830:x1875840068489728:12345-0@lo:501: Request processed in 332us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940587.796670:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788940587.796803:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f981b0dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068489728:0@lo:501: 00000100:00100000:0.0:1788940587.796873:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000924a5395 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068489856:0@lo:503: 00000100:00100000:0.0:1788940587.796956:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940587.797013:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f32f438a going to sleep for 11 seconds 00000100:00100000:3.0:1788940587.799787:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068489856 00000100:00100000:3.0:1788940587.799809:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068489856 00000100:00100000:3.0:1788940587.799885:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788940587.799896:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000043f2e243 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5830:x1875840068489856:12345-0@lo:503: 00000100:00100000:3.0:1788940587.800223:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000043f2e243 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5830:x1875840068489856:12345-0@lo:503: Request processed in 328us (3267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940587.800232:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788940587.801711:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000924a5395 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068489856:0@lo:503: 00000100:00100000:3.0:1788940587.805742:0:6412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000061610e56 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6412:1875840068489984:0@lo:502: 00000100:00100000:3.0:1788940587.805872:0:6412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940587.805959:0:6412:0:(client.c:2716:ptlrpc_set_wait()) set 000000004632bf08 going to sleep for 11 seconds 00000100:00100000:0.0:1788940587.807385:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068489984 00000100:00100000:0.0:1788940587.807401:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068489984 00000100:00100000:0.0:1788940587.807490:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940587.807500:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005025b49a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6412:x1875840068489984:12345-0@lo:502: 00000100:00100000:0.0:1788940587.807805:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005025b49a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6412:x1875840068489984:12345-0@lo:502: Request processed in 306us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940587.807815:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788940587.810182:0:6412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000061610e56 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6412:1875840068489984:0@lo:502: 00000020:01000000:2.0:1788940587.810308:0:6412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940587.810324:0:6412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940587.810327:0:6412:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788940587.810347:0:6412:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f411876b000 00000020:00000080:2.0:1788940587.810351:0:6412:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788940587.810431:0:6412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6412:1875840068490112:0@lo:502: 00000100:00100000:2.0:1788940587.810540:0:6412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940587.810598:0:6412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41080e2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940587.811367:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068490112 00000100:00100000:3.0:1788940587.811380:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068490112 00000100:00100000:3.0:1788940587.811449:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940587.811461:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6412:x1875840068490112:12345-0@lo:502: 00000100:00100000:3.0:1788940587.811739:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6412:x1875840068490112:12345-0@lo:502: Request processed in 279us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940587.811757:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788940587.819559:0:6412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6412:1875840068490112:0@lo:502: 00000020:01000000:2.0:1788940587.819641:0:6412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940587.819658:0:6412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940587.819662:0:6412:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788940587.819667:0:6412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788940587.819905:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788940587.819936:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940587.819951:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa2a6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a73 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940587.819966:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa2a6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2a73 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940588.616650:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940589.640656:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940590.664570:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940591.688342:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940592.648466:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068490368:0@lo:400: 00000100:00100000:0.0:1788940592.648543:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940592.648614:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940592.648621:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068490240:0@lo:400: 00000100:00100000:0.0:1788940592.648651:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940592.648690:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068490240 00000100:00100000:0.0:1788940592.648698:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068490240 00000100:00100000:0.0:1788940592.648742:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788940592.648752:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:3302:x1875840068490240:12345-0@lo:400: 00000100:00100000:0.0:1788940592.648802:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:3302:x1875840068490240:12345-0@lo:400: Request processed in 51us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940592.648810:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788940592.648857:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068490240:0@lo:400: 00000100:00100000:3.0:1788940592.648991:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068490368 00000100:00100000:3.0:1788940592.648996:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068490368 00000100:00100000:3.0:1788940592.649042:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940592.649050:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068490368:12345-0@lo:400: 00000100:00100000:3.0:1788940592.649099:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068490368:12345-0@lo:400: Request processed in 50us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940592.649106:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788940592.649271:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f4141512300 x1875840068490368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940592.649284:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068490368:0@lo:400: 00000020:01000004:2.0:1788940592.650129:0:6668:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788940592.650132:0:6668:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788940592.650841:0:6668:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f410f4f2000 00000020:01000004:3.0:1788940592.650858:0:6668:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788940592.650869:0:6668:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788940592.650883:0:6668:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f4141523380) 00000020:00000080:3.0:1788940592.650901:0:6668:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788940592.668969:0:6668:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788940592.669421:0:6668:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788940592.688311:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788940592.693659:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788940592.693696:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788940592.693756:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788940592.693784:0:6668:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788940592.694156:0:6668:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788940592.694170:0:6668:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788940592.694181:0:6668:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa1d8aa9164aa2a81 00000020:01000004:3.0:1788940592.694223:0:6668:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788940592.694245:0:6668:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.117@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788940592.694248:0:6668:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788940592.694260:0:6668:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788940592.694265:0:6668:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788940592.694285:0:6668:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f4134e5cd40) 00000020:00000080:3.0:1788940592.694296:0:6668:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788940592.695357:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940592.695524:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788940592.695531:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788940592.701412:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788940592.701436:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788940592.702508:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788940592.702518:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788940592.704138:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940592.704367:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788940592.704373:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788940592.708315:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788940592.708328:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:3.0:1788940592.713581:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940592.748666:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940592.748997:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788940592.749005:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788940592.756615:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788940592.756631:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788940592.757898:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788940592.757912:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788940592.764045:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940592.764991:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788940592.764999:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788940592.766219:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788940592.766228:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788940592.889708:0:6668:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940592.889995:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788940592.890001:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788940592.892995:0:6668:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788940592.893012:0:6668:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788940592.894821:0:6668:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788940592.894854:0:6668:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788940592.894862:0:6668:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.117@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788940592.916441:0:6668:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.117@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788940592.916545:0:6668:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.117@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788940592.916549:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788940592.916555:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788940592.916557:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940592.916558:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940592.916559:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940592.916560:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940592.916561:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788940592.916562:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788940592.916563:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788940592.916565:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940592.916566:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788940592.916569:0:6668:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788940592.916571:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788940592.916572:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788940592.916573:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940592.916574:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940592.916575:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940592.916576:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940592.916577:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788940592.916579:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788940592.916580:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788940592.916581:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940592.916582:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788940592.916617:0:6668:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788940592.916636:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068490496:0@lo:253: 00000100:00100000:1.0:1788940592.916715:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940592.916910:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4102af0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940592.917004:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068490496 00000100:00100000:2.0:1788940592.917014:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068490496 00000100:00100000:2.0:1788940592.917116:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788940592.917127:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6668:x1875840068490496:12345-0@lo:253: 20000000:01000000:2.0:1788940592.917165:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788940592.917170:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788940592.917175:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788940592.917178:0:5827:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788940592.918713:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940592.919043:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788940592.919057:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788940592.919111:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788940592.919119:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788940592.919148:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788940592.919355:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788940592.919892:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788940592.919915:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.117@tcp 20000000:01000000:1.0:1788940592.919917:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.117@tcp (null) (null) (null) 00000040:00080000:1.0:1788940592.919949:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788940592.919967:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788940592.920016:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788940592.920024:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.117@tcp (null) (null) 00000040:00080000:1.0:1788940592.920052:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788940592.920061:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788940592.920109:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788940592.920174:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788940592.921063:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788940592.921096:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.117@tcp 20000000:01000000:1.0:1788940592.921098:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.117@tcp (null) (null) (null) 00000040:00080000:1.0:1788940592.921133:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788940592.921141:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788940592.921168:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788940592.921174:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.117@tcp (null) (null) 00000040:00080000:1.0:1788940592.921344:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788940592.921354:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788940592.921386:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788940592.921422:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788940592.921438:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788940592.921441:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788940592.921447:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788940592.921448:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788940592.921450:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788940592.921527:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788940592.921531:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788940592.921566:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788940592.921569:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788940592.927978:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788940592.928551:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788940592.928601:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788940592.928756:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1788940592.928841:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788940592.928844:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788940592.934223:0:6685:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788940592.934326:0:6685:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788940592.934358:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788940592.934619:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788940592.934664:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788940592.934698:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788940592.934711:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788940592.934714:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788940592.935846:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1788940592.935914:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1788940592.935958:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788940592.936413:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788940592.936454:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788940592.936586:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:1.0:1788940592.936608:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788940592.936638:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940592.936658:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f412bfc7e00/0xa1d8aa9164aa29a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa29a1 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940592.936667:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa29c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa29bd expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940592.936674:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f412bfc7200/0xa1d8aa9164aa2a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a2d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940592.936680:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940592.936719:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f412bfc7200/0xa1d8aa9164aa2a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2a2d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940592.936734:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f412bfc7200/0xa1d8aa9164aa2a34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a2d expref: 12 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940592.936748:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a045c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875840068490624:0@lo:104: 00000100:00100000:1.0:1788940592.936891:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940592.937032:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa29c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa29bd expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940592.937042:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa29c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa29bd expref: 12 pid: 5826 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940592.937051:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a044a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875840068490752:0@lo:104: 00000100:00100000:1.0:1788940592.937095:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940592.937422:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f412bfc7e00/0xa1d8aa9164aa29a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa29a1 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940592.937430:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f412bfc7e00/0xa1d8aa9164aa29a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa29a1 expref: 12 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940592.937439:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875840068490880:0@lo:104: 00000100:00100000:1.0:1788940592.937474:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940592.937591:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068490624 00000100:00100000:3.0:1788940592.937601:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068490624 00000100:00100000:3.0:1788940592.937642:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068490752 00000100:00100000:3.0:1788940592.937645:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068490752 00000100:00100000:3.0:1788940592.937660:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940592.937668:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a045500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+4:5827:x1875840068490624:12345-0@lo:104: 00010000:00010000:3.0:1788940592.937682:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2a34 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940592.937737:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940592.937744:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a045500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+4:5827:x1875840068490624:12345-0@lo:104: Request processed in 76us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940592.937750:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940592.937778:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940592.937792:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:5827:x1875840068490752:12345-0@lo:104: 00010000:00010000:3.0:1788940592.937800:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa29bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa29c4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940592.937833:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940592.937837:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:5827:x1875840068490752:12345-0@lo:104: Request processed in 47us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940592.937843:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788940592.937859:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940592.937864:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2a34 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940592.937872:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37800 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:3.0:1788940592.937876:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2a34 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940592.937884:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2a34 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940592.937892:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2a34 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940592.937897:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940592.937924:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2a2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a34 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940592.937930:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940592.937944:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2a2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a34 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940592.937960:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2a2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a34 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940592.937971:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940592.937975:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa29bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa29c4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940592.937980:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6400 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:3.0:1788940592.937983:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa29bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa29c4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940592.937990:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa29bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa29c4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940592.937996:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa29bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa29c4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940592.938001:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940592.938013:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa29bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa29c4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940592.938019:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940592.938024:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa29bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa29c4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940592.938030:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa29bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa29c4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940592.938038:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940592.938045:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940592.938047:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940592.938138:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940592.938153:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068491008:0@lo:103: 00000100:00100000:2.0:1788940592.938204:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940592.938232:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940592.938238:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068491136:0@lo:103: 00000100:00100000:2.0:1788940592.938260:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940592.938290:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068491008 00000100:00100000:2.0:1788940592.938294:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068491008 00010000:00010000:2.0:1788940592.938315:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f412bfc7200/0xa1d8aa9164aa2a34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a2d expref: 13 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940592.938344:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068491136 00000100:00100000:2.0:1788940592.938347:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068491136 00010000:00010000:2.0:1788940592.938358:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa29c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa29bd expref: 14 pid: 5826 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940592.938369:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940592.938374:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:3303:x1875840068491008:12345-0@lo:103: 00010000:00010000:2.0:1788940592.938385:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940592.938390:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f412bfc7200/0xa1d8aa9164aa2a34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a2d expref: 14 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.938399:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f412bfc7200/0xa1d8aa9164aa2a34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a2d expref: 14 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.938413:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940592.938441:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:3303:x1875840068491008:12345-0@lo:103: Request processed in 66us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940592.938447:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940592.938459:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940592.938477:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:3303:x1875840068491136:12345-0@lo:103: 00010000:00010000:2.0:1788940592.938485:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940592.938489:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa29c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa29bd expref: 13 pid: 5826 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.938501:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa29c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa29bd expref: 13 pid: 5826 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.938509:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940592.938539:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:3303:x1875840068491136:12345-0@lo:103: Request processed in 63us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940592.938546:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940592.938585:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068491136:0@lo:103: 00000100:00100000:2.0:1788940592.938594:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068491008:0@lo:103: 00000100:00100000:1.0:1788940592.939006:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f179d80 going to sleep for 11 seconds 00010000:00010000:1.0:1788940592.939022:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc7200/0xa1d8aa9164aa2a34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a2d expref: 12 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940592.939034:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a045c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875840068490624:0@lo:104: 00010000:00010000:1.0:1788940592.939043:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa29c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa29bd expref: 11 pid: 5826 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940592.939050:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a044a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875840068490752:0@lo:104: 00000100:00100000:0.0:1788940592.939152:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068490880 00000100:00100000:0.0:1788940592.939158:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068490880 00000100:00100000:3.0:1788940592.939300:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940592.939310:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a046d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:5827:x1875840068490880:12345-0@lo:104: 00010000:00010000:3.0:1788940592.939320:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa29a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa29a8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940592.939443:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940592.939449:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a046d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:5827:x1875840068490880:12345-0@lo:104: Request processed in 142us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940592.939455:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788940592.939568:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940592.939574:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa29a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa29a8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939581:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030c00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:2.0:1788940592.939584:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa29a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa29a8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939593:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa29a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa29a8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940592.939600:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa29a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa29a8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940592.939606:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940592.939640:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa29a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa29a8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939647:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940592.939666:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa29a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa29a8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939673:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa29a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa29a8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939698:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940592.939700:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940592.939702:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940592.939715:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068491264:0@lo:103: 00000100:00100000:2.0:1788940592.939747:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940592.939800:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068491264 00000100:00100000:2.0:1788940592.939804:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068491264 00010000:00010000:2.0:1788940592.939821:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f412bfc7e00/0xa1d8aa9164aa29a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa29a1 expref: 11 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940592.939843:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940592.939849:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:3301:x1875840068491264:12345-0@lo:103: 00010000:00010000:2.0:1788940592.939859:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940592.939862:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f412bfc7e00/0xa1d8aa9164aa29a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa29a1 expref: 11 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939871:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f412bfc7e00/0xa1d8aa9164aa29a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa29a1 expref: 11 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939886:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939894:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939919:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939927:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939940:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939947:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939953:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940592.939958:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939966:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939975:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940592.939984:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940592.940009:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:3301:x1875840068491264:12345-0@lo:103: Request processed in 161us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940592.940016:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940592.940044:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068491264:0@lo:103: 00010000:00010000:1.0:1788940592.940550:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc7e00/0xa1d8aa9164aa29a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa29a1 expref: 10 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940592.940563:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5827:1875840068490880:0@lo:104: 00010000:00010000:1.0:1788940592.940585:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940592.940601:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940592.940607:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940592.940613:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2a8f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788940592.940628:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788940593.012884:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+9:6668:x1875840068490496:12345-0@lo:253: Request processed in 95748us (96158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940593.012899:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940593.013018:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068490496:0@lo:253: 10000000:01000000:1.0:1788940593.013035:0:6668:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788940593.013038:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788940593.013040:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788940593.013041:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940593.013043:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788940593.013044:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940593.013046:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940593.013047:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788940593.013049:0:6668:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788940593.013051:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940593.013052:0:6668:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788940593.013182:0:6668:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f410f4f2000 from lustre-OST0000 10000000:01000000:1.0:1788940593.013236:0:6668:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788940593.013240:0:6668:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788940593.013246:0:6668:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f4118288000 local copy 10000000:01000000:1.0:1788940593.013251:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788940593.013293:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940593.013304:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940593.013335:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940593.013356:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068491392:0@lo:101: 00000100:00100000:1.0:1788940593.013402:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940593.013719:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068491392 00000100:00100000:0.0:1788940593.013726:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068491392 00000100:00100000:1.0:1788940593.013827:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f179780 going to sleep for 11 seconds 00000100:00100000:0.0:1788940593.013980:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788940593.013991:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+9:6668:x1875840068491392:12345-0@lo:101: 00010000:00010000:0.0:1788940593.014006:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940593.014022:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4100030c00/0xa1d8aa9164aa2a9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2a96 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940593.014312:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4100030c00/0xa1d8aa9164aa2a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a96 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940593.014325:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4100030c00/0xa1d8aa9164aa2a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a96 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940593.014333:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100030c00, rc 0) 00000100:00100000:0.0:1788940593.014443:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+10:6668:x1875840068491392:12345-0@lo:101: Request processed in 454us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940593.014450:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940593.014725:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068491392:0@lo:101: 00010000:00010000:1.0:1788940593.014740:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa1d8aa9164aa2a9d expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940593.014749:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa1d8aa9164aa2a9d expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940593.014854:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068491520:0@lo:501: 00000100:00100000:1.0:1788940593.014887:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940593.014921:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f179780 going to sleep for 11 seconds 00000100:00100000:3.0:1788940593.014979:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068491520 00000100:00100000:3.0:1788940593.014985:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068491520 00000100:00100000:3.0:1788940593.015151:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788940593.015162:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+10:6668:x1875840068491520:12345-0@lo:501: 00000100:00100000:3.0:1788940593.015411:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+10:6668:x1875840068491520:12345-0@lo:501: Request processed in 251us (523us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940593.015419:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788940593.015857:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068491520:0@lo:501: 10000000:01000000:2.0:1788940593.015873:0:6668:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788940593.015905:0:6668:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788940593.015911:0:6668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa1d8aa9164aa2a9d expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.015920:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa1d8aa9164aa2a9d expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.015933:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa1d8aa9164aa2a9d expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.015952:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788940593.015972:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f410f4f2000 10000000:01000000:2.0:1788940593.015976:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788940593.015981:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f4118288000 10000000:01000000:2.0:1788940593.015984:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788940593.015988:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f4118288000 from 1 10000000:01000000:2.0:1788940593.015991:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788940593.016015:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa2aa4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.016022:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa2aa4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.016032:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa2aa4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940593.016046:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068491648:0@lo:101: 00000100:00100000:2.0:1788940593.016101:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940593.016129:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7c540 going to sleep for 11 seconds 00010000:00010000:2.0:1788940593.016144:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940593.016150:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa1d8aa9164aa2a9d expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.016158:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051e00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:2.0:1788940593.016161:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa1d8aa9164aa2a9d expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.016176:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa1d8aa9164aa2a9d expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940593.016183:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa1d8aa9164aa2a9d expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940593.016215:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940593.016235:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa1d8aa9164aa2a9d expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.016242:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940593.016260:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa1d8aa9164aa2a9d expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.016267:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4142051e00/0xa1d8aa9164aa2a96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa1d8aa9164aa2a9d expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.016284:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940593.016285:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940593.016287:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940593.016299:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068491776:0@lo:103: 00000100:00100000:2.0:1788940593.016327:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940593.016362:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068491776 00000100:00100000:2.0:1788940593.016367:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068491776 00000100:00100000:2.0:1788940593.016402:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940593.016410:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+10:3302:x1875840068491776:12345-0@lo:103: 00010000:00010000:2.0:1788940593.016433:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940593.016446:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4100030c00/0xa1d8aa9164aa2a9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a96 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.016719:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940593.016753:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+9:3302:x1875840068491776:12345-0@lo:103: Request processed in 344us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940593.016760:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940593.016788:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068491776:0@lo:103: 00000100:00100000:2.0:1788940593.016814:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068491648 00000100:00100000:2.0:1788940593.016817:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068491648 00000100:00100000:2.0:1788940593.016833:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788940593.016838:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+9:6668:x1875840068491648:12345-0@lo:101: 00010000:00010000:2.0:1788940593.016848:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940593.016858:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6800/0xa1d8aa9164aa2aab lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2aa4 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.016875:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6800/0xa1d8aa9164aa2aab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2aa4 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.016885:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc6800/0xa1d8aa9164aa2aab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2aa4 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.016892:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6800, rc 0) 00000100:00100000:2.0:1788940593.016920:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+10:6668:x1875840068491648:12345-0@lo:101: Request processed in 81us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940593.016926:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788940593.016954:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068491648:0@lo:101: 00010000:00010000:2.0:1788940593.016965:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa2aa4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2aab expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.016983:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa2aa4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2aab expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940593.017000:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788940593.017009:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa2aa4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2aab expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.017016:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa2aa4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2aab expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940593.017022:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788940593.017026:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788940593.017031:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788940593.017033:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788940593.017046:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.017052:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.017135:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940593.017148:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068491904:0@lo:101: 00000100:00100000:2.0:1788940593.017173:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940593.017222:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940593.017238:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068491904 00000100:00100000:2.0:1788940593.017241:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068491904 00000100:00100000:2.0:1788940593.017265:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788940593.017270:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+10:6668:x1875840068491904:12345-0@lo:101: 00010000:00010000:2.0:1788940593.017276:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940593.017284:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2ab9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2ab2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.017296:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ab2 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.017304:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ab2 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.017310:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6600, rc 0) 00000100:00100000:2.0:1788940593.017338:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:6668:x1875840068491904:12345-0@lo:101: Request processed in 67us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940593.017343:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788940593.017434:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068491904:0@lo:101: 00010000:00010000:2.0:1788940593.017445:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ab9 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.017451:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2ab9 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940593.017770:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492032:0@lo:501: 00000100:00100000:2.0:1788940593.017796:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940593.017827:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940593.017909:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068492032 00000100:00100000:0.0:1788940593.017914:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068492032 00000100:00100000:0.0:1788940593.017936:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788940593.017943:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:6668:x1875840068492032:12345-0@lo:501: 00000100:00100000:0.0:1788940593.018206:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:6668:x1875840068492032:12345-0@lo:501: Request processed in 242us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940593.018214:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788940593.018458:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492032:0@lo:501: 00000100:00100000:2.0:1788940593.018566:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492160:0@lo:503: 00000100:00100000:2.0:1788940593.020602:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940593.020645:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940593.020737:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068492160 00000100:00100000:0.0:1788940593.020746:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068492160 00000100:00100000:0.0:1788940593.020841:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788940593.020850:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:6668:x1875840068492160:12345-0@lo:503: 00000100:00100000:0.0:1788940593.021164:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:6668:x1875840068492160:12345-0@lo:503: Request processed in 314us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940593.021172:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788940593.021308:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492160:0@lo:503: 00000040:00080000:2.0:1788940593.021917:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788940593.022030:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492288:0@lo:502: 00000100:00100000:2.0:1788940593.022381:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940593.022928:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940593.023008:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068492288 00000100:00100000:3.0:1788940593.023017:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068492288 00000100:00100000:3.0:1788940593.023166:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788940593.023179:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:6668:x1875840068492288:12345-0@lo:502: 00000100:00100000:2.0:1788940593.023601:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492288:0@lo:502: 00000040:00080000:2.0:1788940593.024051:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788940593.024258:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788940593.024290:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788940593.024335:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788940593.024373:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788940593.024407:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788940593.024457:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492416:0@lo:502: 00000100:00100000:2.0:1788940593.024641:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940593.024669:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940593.024828:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:6668:x1875840068492288:12345-0@lo:502: Request processed in 245us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940593.024841:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788940593.024884:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068492416 00000100:00100000:3.0:1788940593.024890:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068492416 00000100:00100000:3.0:1788940593.024917:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788940593.024934:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:6668:x1875840068492416:12345-0@lo:502: 00000100:00100000:3.0:1788940593.025253:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:6668:x1875840068492416:12345-0@lo:502: Request processed in 319us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940593.025259:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788940593.025386:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492416:0@lo:502: 00000040:00080000:2.0:1788940593.025634:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788940593.025647:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1788940593.027403:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940593.027415:0:6687:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788940593.028104:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940593.028109:0:6687:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788940593.028120:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940593.028149:0:6687:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f413f41cd40) 00000020:00000080:1.0:1788940593.028173:0:6687:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788940593.028181:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788940593.028278:0:6687:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f410f4f2000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788940593.028286:0:6687:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788940593.028292:0:6687:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa1d8aa9164aa2ac7 00010000:00010000:1.0:1788940593.035954:0:6687:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788940593.036344:0:6687:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788940593.043603:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788940593.044018:0:6687:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788940593.056287:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788940593.058815:0:6687:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788940593.065253:0:6687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788940593.065274:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940593.065281:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940593.065283:0:6687:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788940593.065288:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940593.065292:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940593.065293:0:6687:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788940593.065296:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788940593.065298:0:6687:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788940593.065359:0:6687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940593.065363:0:6687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940593.065364:0:6687:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788940593.065367:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788940593.068857:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788940593.068897:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788940593.068925:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ab9 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.068939:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ab9 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940593.068959:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f410f4f2000 from 1 10000000:01000000:2.0:1788940593.068962:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940593.068995:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.069002:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.069013:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940593.069035:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492544:0@lo:101: 00000100:00100000:2.0:1788940593.069111:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940593.069160:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940593.069296:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068492544 00000100:00100000:2.0:1788940593.069303:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068492544 00000100:00100000:2.0:1788940593.069338:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788940593.069345:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:6668:x1875840068492544:12345-0@lo:101: 00010000:00010000:2.0:1788940593.069357:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940593.069369:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ad5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2ace expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.069390:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ad5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ace expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.069401:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ad5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ace expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.069409:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6400, rc 0) 00000100:00100000:2.0:1788940593.069721:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6668:x1875840068492544:12345-0@lo:101: Request processed in 374us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940593.069728:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788940593.069771:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492544:0@lo:101: 00010000:00010000:2.0:1788940593.069783:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ad5 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.069793:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2ad5 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940593.069879:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492672:0@lo:501: 00000100:00100000:2.0:1788940593.069901:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940593.069921:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940593.069997:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068492672 00000100:00100000:0.0:1788940593.070001:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068492672 00000100:00100000:0.0:1788940593.070020:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940593.070026:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6668:x1875840068492672:12345-0@lo:501: 00000100:00100000:0.0:1788940593.070260:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6668:x1875840068492672:12345-0@lo:501: Request processed in 233us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940593.070267:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788940593.071789:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492672:0@lo:501: 00000100:00100000:2.0:1788940593.071841:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492800:0@lo:503: 00000100:00100000:2.0:1788940593.071904:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940593.071948:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940593.071968:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068492800 00000100:00100000:2.0:1788940593.071973:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068492800 00000100:00100000:2.0:1788940593.072008:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788940593.072016:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6668:x1875840068492800:12345-0@lo:503: 00000100:00100000:2.0:1788940593.072369:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6668:x1875840068492800:12345-0@lo:503: Request processed in 353us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940593.072377:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788940593.072418:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492800:0@lo:503: 00000040:00080000:2.0:1788940593.075181:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788940593.075305:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492928:0@lo:502: 00000100:00100000:2.0:1788940593.075377:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940593.075420:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940593.076700:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068492928 00000100:00100000:0.0:1788940593.076713:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068492928 00000100:00100000:0.0:1788940593.076764:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940593.076774:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6668:x1875840068492928:12345-0@lo:502: 00000100:00100000:0.0:1788940593.077050:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6668:x1875840068492928:12345-0@lo:502: Request processed in 277us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940593.077059:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940593.077135:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068492928:0@lo:502: 00000040:00080000:0.0:1788940593.077441:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788940593.077713:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788940593.077746:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068493056:0@lo:502: 00000100:00100000:0.0:1788940593.077795:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940593.077823:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410a750cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940593.077898:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068493056 00000100:00100000:1.0:1788940593.077904:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068493056 00000100:00100000:1.0:1788940593.077939:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788940593.077947:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6668:x1875840068493056:12345-0@lo:502: 00000100:00100000:1.0:1788940593.078085:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6668:x1875840068493056:12345-0@lo:502: Request processed in 138us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940593.078093:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788940593.078246:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068493056:0@lo:502: 00000040:00080000:0.0:1788940593.078338:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788940593.078348:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788940593.085995:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940593.086025:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940593.086027:0:6691:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788940593.086035:0:6691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f410f4f2000 00000020:00000080:2.0:1788940593.086037:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788940593.086056:0:6691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940593.086059:0:6691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940593.086060:0:6691:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788940593.086063:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788940593.087603:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788940593.087648:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940593.087668:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ad5 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940593.087681:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ad5 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940593.087730:0:6668:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788940593.087733:0:6668:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f410f4f2000 10000000:01000000:1.0:1788940593.087736:0:6668:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f410f4f2000 10000000:01000000:1.0:1788940593.087740:0:6668:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940593.087746:0:6668:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f410f4f2000 from 1 10000000:01000000:1.0:1788940593.087749:0:6668:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788940593.087787:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940593.087795:0:6668:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940593.087824:0:6668:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940593.087848:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068493184:0@lo:101: 00000100:00100000:1.0:1788940593.087922:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940593.087964:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f179000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940593.088204:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068493184 00000100:00100000:2.0:1788940593.088212:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068493184 00000100:00100000:2.0:1788940593.088265:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788940593.088276:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6668:x1875840068493184:12345-0@lo:101: 00010000:00010000:2.0:1788940593.088291:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940593.088305:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa2ae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2adc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.088329:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa2ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2adc expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.088341:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa2ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2adc expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.088349:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6000, rc 0) 00000100:00100000:2.0:1788940593.088411:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:6668:x1875840068493184:12345-0@lo:101: Request processed in 138us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940593.088418:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788940593.088998:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068493184:0@lo:101: 00010000:00010000:3.0:1788940593.089016:0:6668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ae3 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940593.089026:0:6668:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2ae3 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940593.089137:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068493312:0@lo:501: 00000100:00100000:3.0:1788940593.089172:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940593.089222:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410f69a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788940593.089410:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068493312 00000100:00100000:2.0:1788940593.089416:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068493312 00000100:00100000:2.0:1788940593.089471:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788940593.089479:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:6668:x1875840068493312:12345-0@lo:501: 00000100:00100000:2.0:1788940593.089885:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:6668:x1875840068493312:12345-0@lo:501: Request processed in 405us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940593.089893:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788940593.089965:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068493312:0@lo:501: 00000100:00100000:0.0:1788940593.089995:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068493440:0@lo:503: 00000100:00100000:0.0:1788940593.090039:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940593.090105:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410a750cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940593.090180:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068493440 00000100:00100000:3.0:1788940593.090210:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068493440 00000100:00100000:3.0:1788940593.090233:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788940593.090240:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:6668:x1875840068493440:12345-0@lo:503: 00000100:00100000:3.0:1788940593.090391:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:6668:x1875840068493440:12345-0@lo:503: Request processed in 151us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940593.090397:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788940593.090597:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068493440:0@lo:503: 00000040:00080000:0.0:1788940593.090871:0:6668:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940593.090927:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068493568:0@lo:502: 00000100:00100000:0.0:1788940593.090962:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940593.090981:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410a750cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940593.091166:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068493568 00000100:00100000:1.0:1788940593.091171:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068493568 00000100:00100000:1.0:1788940593.091222:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788940593.091231:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:6668:x1875840068493568:12345-0@lo:502: 00000100:00100000:1.0:1788940593.091396:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:6668:x1875840068493568:12345-0@lo:502: Request processed in 166us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940593.091402:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788940593.092294:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068493568:0@lo:502: 00000040:00080000:0.0:1788940593.093253:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788940593.093316:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788940593.093344:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788940593.093380:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788940593.093409:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788940593.093721:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788940593.093755:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788940593.093786:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788940593.093849:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788940593.093890:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788940593.093924:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788940593.093966:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788940593.094003:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788940593.094042:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788940593.095852:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788940593.095925:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788940593.095962:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788940593.096014:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788940593.096048:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788940593.097112:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788940593.097179:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788940593.097606:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788940593.098408:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788940593.098592:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788940593.098705:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788940593.098739:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788940593.098784:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788940593.098820:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788940593.098867:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068493696:0@lo:502: 00000100:00100000:0.0:1788940593.098945:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940593.098994:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410a750cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940593.099272:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068493696 00000100:00100000:1.0:1788940593.099281:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068493696 00000100:00100000:1.0:1788940593.099333:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788940593.099343:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:6668:x1875840068493696:12345-0@lo:502: 00000100:00100000:1.0:1788940593.099567:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:6668:x1875840068493696:12345-0@lo:502: Request processed in 225us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940593.099575:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788940593.100170:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068493696:0@lo:502: 00000040:00080000:0.0:1788940593.100300:0:6668:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788940593.100315:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788940593.102340:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788940593.102357:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f4134e599c0) 00000020:00000080:3.0:1788940593.102378:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788940593.102481:0:6692:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f410f4f2000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788940593.102485:0:6692:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f410f4f2000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788940593.102488:0:6692:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f410f4f2000 3 00010000:00080000:3.0:1788940593.102517:0:6692:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f413f3b7000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.117@tcp at head 00010000:00010000:3.0:1788940593.105682:0:6692:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788940593.105910:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788940593.105954:0:6692:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788940593.105969:0:6692:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa1d8aa9164aa2af1 00000100:00080000:3.0:1788940593.105980:0:6692:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788940593.105993:0:6692:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f413f3b7000 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:3.0:1788940593.106029:0:6692:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4141511c00 x1875840068493824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940593.106079:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1875840068493824:0@lo:38: 00000100:00100000:3.0:1788940593.106161:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940593.106253:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068493824 00000100:00100000:3.0:1788940593.106260:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068493824 00000100:00100000:3.0:1788940593.106293:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940593.106301:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1875840068493824:12345-0@lo:38: 00010000:00080000:3.0:1788940593.106325:0:5833:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:3.0:1788940593.106364:0:5833:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa1d8aa9164aa2af8 00000004:00100000:3.0:1788940593.106381:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788940593.106424:0:5833:0:(import.c:65:import_set_state_nolock()) ffff8f4139f97000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940593.106474:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875840068493824:12345-0@lo:38: Request processed in 173us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940593.106481:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788940593.106516:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f4141511c00 x1875840068493824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940593.106526:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788940593.106533:0:3300:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788940593.106540:0:3300:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788940593.106550:0:3300:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788940593.106553:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f413f3b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788940593.106559:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1875840068493824:0@lo:38: 00000100:00080000:3.0:1788940593.106577:0:6692:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788940593.106630:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068493952:0@lo:400: 00000100:00100000:3.0:1788940593.106655:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940593.106686:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068493952 00000100:00100000:3.0:1788940593.106689:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068493952 00000100:00100000:3.0:1788940593.106712:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940593.106718:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068493952:12345-0@lo:400: 00000100:00100000:3.0:1788940593.106749:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068493952:12345-0@lo:400: Request processed in 30us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940593.106755:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788940593.106777:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f4141511c00 x1875840068493952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940593.106786:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068493952:0@lo:400: 00000040:00080000:2.0:1788940593.110733:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788940593.112602:0:6668:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788940593.112649:0:6668:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940593.112679:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ae3 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940593.112692:0:6668:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ae3 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788940593.112758:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788940593.112764:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788940593.112765:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940593.112767:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940593.112768:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940593.112770:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940593.112771:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940593.112772:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788940593.112774:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788940593.112775:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940593.112776:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940593.112780:0:6668:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788940593.112782:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788940593.112784:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788940593.112785:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940593.112786:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940593.112787:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940593.112788:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940593.112789:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940593.112790:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788940593.112791:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788940593.112792:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940593.112793:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940593.112816:0:6668:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788940593.112833:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068494080:0@lo:253: 00000100:00100000:0.0:1788940593.112907:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940593.112948:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410a7509c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940593.113302:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068494080 00000100:00100000:3.0:1788940593.113311:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068494080 00000100:00100000:3.0:1788940593.113364:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788940593.113374:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:6668:x1875840068494080:12345-0@lo:253: 20000000:01000000:3.0:1788940593.113400:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788940593.113414:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788940593.133832:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788940593.133848:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788940593.133888:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788940593.133892:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788940593.133910:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.133925:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a57 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.133930:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.133959:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2a57 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.133970:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2a5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a57 expref: 13 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940593.133979:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134691500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875840068494208:0@lo:104: 00000100:00100000:2.0:1788940593.134032:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940593.134086:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068494208 00000100:00100000:3.0:1788940593.134094:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068494208 00000100:00100000:2.0:1788940593.134099:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940593.134141:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788940593.134289:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:5849:x1875840068494208:12345-0@lo:104: 00010000:00010000:3.0:1788940593.134312:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2a5e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940593.134364:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940593.134370:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:5849:x1875840068494208:12345-0@lo:104: Request processed in 221us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940593.134377:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788940593.134398:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940593.134404:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2a5e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940593.134411:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37a00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:3.0:1788940593.134414:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2a5e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940593.134423:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2a5e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940593.134431:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2a5e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940593.134437:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940593.134467:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2a57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a5e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940593.134473:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940593.134497:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2a57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a5e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940593.134504:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2a57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a5e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940593.134529:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940593.134531:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940593.134532:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940593.134540:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940593.134552:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068494336:0@lo:103: 00000100:00100000:3.0:1788940593.134584:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940593.134640:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134691500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875840068494208:0@lo:104: 00010000:00010000:3.0:1788940593.134659:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940593.134760:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068494336 00000100:00100000:2.0:1788940593.134765:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068494336 00010000:00010000:2.0:1788940593.134783:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2a5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a57 expref: 14 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940593.134820:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940593.134827:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4107398850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:3303:x1875840068494336:12345-0@lo:103: 00010000:00010000:2.0:1788940593.134839:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940593.134844:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2a5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a57 expref: 14 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.134854:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a57 expref: 14 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.134863:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2a5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a57 expref: 14 pid: 5827 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.134873:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.134878:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788940593.134888:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005382423s 00010000:00010000:2.0:1788940593.134891:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.134895:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.134900:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.134904:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.134914:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940593.134917:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.134922:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.134935:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940593.134944:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940593.134950:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940593.134957:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940593.134964:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa2aff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940593.134985:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4107398850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:3303:x1875840068494336:12345-0@lo:103: Request processed in 158us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940593.134991:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940593.135150:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068494336:0@lo:103: 00000100:00100000:1.0:1788940593.140540:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:6668:x1875840068494080:12345-0@lo:253: Request processed in 27158us (27623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940593.140556:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788940593.140767:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6668:1875840068494080:0@lo:253: 10000000:01000000:0.0:1788940593.140784:0:6668:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788940593.140788:0:6668:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940593.140789:0:6668:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788940593.140791:0:6668:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940593.140792:0:6668:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940593.140793:0:6668:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940593.140794:0:6668:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940593.140795:0:6668:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940593.140797:0:6668:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788940593.140798:0:6668:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788940593.140800:0:6668:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940593.140807:0:6668:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788940593.140823:0:6668:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788940593.149549:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940593.149669:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788940593.149835:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940593.149936:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788940593.150059:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940593.150323:0:6668:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788940593.151594:0:6668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788940593.409646:0:6668:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788940593.409653:0:6668:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788940593.409688:0:6668:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788940593.409747:0:6668:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.117@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788940593.409762:0:6668:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788940593.409790:0:6668:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788940593.736439:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788940594.635739:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788940594.635749:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f411876b000 from 21 10000000:01000000:2.0:1788940594.635754:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788940594.635797:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940594.635810:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940594.635835:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940594.635859:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068494464:0@lo:101: 00000100:00100000:2.0:1788940594.635925:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940594.635979:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114fe240 going to sleep for 11 seconds 00000100:00100000:3.0:1788940594.636033:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068494464 00000100:00100000:3.0:1788940594.636041:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068494464 00000100:00100000:3.0:1788940594.636109:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788940594.636119:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5830:x1875840068494464:12345-0@lo:101: 00010000:00010000:3.0:1788940594.636132:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940594.636144:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa2b0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2b06 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940594.636167:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa2b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b06 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940594.636206:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa2b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b06 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940594.636217:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37a00, rc 0) 00000100:00100000:3.0:1788940594.636261:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:5830:x1875840068494464:12345-0@lo:101: Request processed in 144us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940594.636268:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788940594.636310:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068494464:0@lo:101: 00010000:00010000:3.0:1788940594.636323:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b0d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940594.636332:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2b0d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940594.636377:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068494592:0@lo:501: 00000100:00100000:3.0:1788940594.636399:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940594.636427:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41244b1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940594.636817:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068494592 00000100:00100000:2.0:1788940594.636822:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068494592 00000100:00100000:2.0:1788940594.636852:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788940594.636860:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:5830:x1875840068494592:12345-0@lo:501: 00000100:00100000:2.0:1788940594.637247:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:5830:x1875840068494592:12345-0@lo:501: Request processed in 387us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940594.637255:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788940594.637549:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068494592:0@lo:501: 00000100:00100000:3.0:1788940594.637583:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068494720:0@lo:503: 00000100:00100000:3.0:1788940594.637622:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940594.637653:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41244b1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940594.637697:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068494720 00000100:00100000:2.0:1788940594.637702:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068494720 00000100:00100000:2.0:1788940594.637816:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788940594.637824:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:5830:x1875840068494720:12345-0@lo:503: 00000100:00100000:2.0:1788940594.638228:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:5830:x1875840068494720:12345-0@lo:503: Request processed in 404us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940594.638234:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788940594.638314:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068494720:0@lo:503: 00000100:00100000:3.0:1788940594.649107:0:6749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6749:1875840068494848:0@lo:502: 00000100:00100000:3.0:1788940594.649613:0:6749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940594.649667:0:6749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41244b1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788940594.649850:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068494848 00000100:00100000:2.0:1788940594.649859:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068494848 00000100:00100000:2.0:1788940594.649908:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788940594.649917:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:6749:x1875840068494848:12345-0@lo:502: 00000100:00100000:2.0:1788940594.650268:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:6749:x1875840068494848:12345-0@lo:502: Request processed in 351us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940594.650284:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788940594.650545:0:6749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6749:1875840068494848:0@lo:502: 00000100:00100000:3.0:1788940594.650603:0:6749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6749:1875840068494976:0@lo:502: 00000100:00100000:3.0:1788940594.650636:0:6749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940594.650666:0:6749:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940594.650828:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068494976 00000100:00100000:2.0:1788940594.650833:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068494976 00000100:00100000:2.0:1788940594.650866:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788940594.650873:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:6749:x1875840068494976:12345-0@lo:502: 00000100:00100000:2.0:1788940594.651020:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:6749:x1875840068494976:12345-0@lo:502: Request processed in 136us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940594.651027:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788940594.652551:0:6749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6749:1875840068494976:0@lo:502: 00000040:00080000:3.0:1788940594.652590:0:6749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788940594.653275:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788940594.653295:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940594.653304:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b0d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940594.653316:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b0d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940594.653326:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788940594.653329:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f411876b000 from 4 10000000:01000000:0.0:1788940594.653332:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788940594.653362:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940594.653370:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940594.653380:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940594.653395:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068495104:0@lo:101: 00000100:00100000:0.0:1788940594.653451:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940594.653484:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f179540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940594.653566:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068495104 00000100:00100000:2.0:1788940594.653572:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068495104 00000100:00100000:2.0:1788940594.653613:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788940594.653621:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:5830:x1875840068495104:12345-0@lo:101: 00010000:00010000:2.0:1788940594.653631:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940594.653643:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6a00/0xa1d8aa9164aa2b1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2b14 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940594.653663:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6a00/0xa1d8aa9164aa2b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b14 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940594.653673:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc6a00/0xa1d8aa9164aa2b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b14 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940594.653681:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6a00, rc 0) 00000100:00100000:2.0:1788940594.653723:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068495104:12345-0@lo:101: Request processed in 103us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940594.653729:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940594.655280:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068495104:0@lo:101: 00010000:00010000:0.0:1788940594.655302:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940594.655313:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2b1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940594.655370:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068495232:0@lo:256: 00000100:00100000:0.0:1788940594.655649:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940594.655691:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f179540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940594.655890:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068495232 00000100:00100000:0.0:1788940594.655897:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068495232 00000100:00100000:0.0:1788940594.655935:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788940594.655942:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068495232:12345-0@lo:256: 20000000:01000000:0.0:1788940594.655958:0:5826:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788940594.655973:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788940594.655976:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788940594.656396:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068495232:12345-0@lo:256: Request processed in 451us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940594.656406:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788940594.656851:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068495232:0@lo:256: 10000000:01000000:0.0:1788940594.656896:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788940594.656905:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940594.656915:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940594.656925:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788940594.656927:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788940594.656930:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788940594.656955:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940594.656974:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940594.656983:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940594.656998:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068495360:0@lo:101: 00000100:00100000:0.0:1788940594.657043:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940594.657962:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f179540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940594.658765:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068495360 00000100:00100000:3.0:1788940594.658775:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068495360 00000100:00100000:3.0:1788940594.658830:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788940594.658839:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068495360:12345-0@lo:101: 00010000:00010000:3.0:1788940594.658853:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940594.658869:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4113b37800/0xa1d8aa9164aa2b29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2b22 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940594.658893:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4113b37800/0xa1d8aa9164aa2b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b22 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940594.658903:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4113b37800/0xa1d8aa9164aa2b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b22 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940594.658912:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37800, rc 0) 00000100:00100000:3.0:1788940594.659008:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068495360:12345-0@lo:101: Request processed in 169us (1963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940594.659014:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788940594.660433:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068495360:0@lo:101: 00010000:00010000:0.0:1788940594.660457:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b29 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940594.660469:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2b29 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940594.660536:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068495488:0@lo:501: 00000100:00100000:0.0:1788940594.660579:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940594.660659:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f179540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940594.669734:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068495488 00000100:00100000:2.0:1788940594.669750:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068495488 00000100:00100000:2.0:1788940594.669827:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788940594.669839:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068495488:12345-0@lo:501: 00000100:00100000:2.0:1788940594.670172:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068495488:12345-0@lo:501: Request processed in 334us (9592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940594.670180:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788940594.670449:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068495488:0@lo:501: 00000100:00100000:0.0:1788940594.670497:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068495616:0@lo:503: 00000100:00100000:0.0:1788940594.670542:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940594.670572:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f179540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940594.670586:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068495616 00000100:00100000:0.0:1788940594.670590:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068495616 00000100:00100000:0.0:1788940594.670617:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788940594.670632:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068495616:12345-0@lo:503: 00000100:00100000:0.0:1788940594.670902:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068495616:12345-0@lo:503: Request processed in 271us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940594.670908:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788940594.670945:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068495616:0@lo:503: 00000100:00100000:2.0:1788940594.675485:0:6751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6751:1875840068495744:0@lo:502: 00000100:00100000:2.0:1788940594.675579:0:6751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940594.675619:0:6751:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114fe000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940594.675669:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068495744 00000100:00100000:0.0:1788940594.675676:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068495744 00000100:00100000:0.0:1788940594.675726:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788940594.675735:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:6751:x1875840068495744:12345-0@lo:502: 00000100:00100000:0.0:1788940594.676034:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:6751:x1875840068495744:12345-0@lo:502: Request processed in 299us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940594.676043:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788940594.676372:0:6751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6751:1875840068495744:0@lo:502: 00000020:01000000:2.0:1788940594.676402:0:6751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788940594.676419:0:6751:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788940594.676427:0:6751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940594.676429:0:6751:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788940594.676435:0:6751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788940594.676438:0:6751:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.117@tcp to nid 0x20000c0a8ca75 (192.168.202.117@tcp) 00000020:01000000:2.0:1788940594.676458:0:6751:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788940594.676461:0:6751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788940594.676486:0:6751:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f414129cd40) 00000020:00000080:2.0:1788940594.676506:0:6751:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788940594.676513:0:6751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788940594.676628:0:6751:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788940594.676634:0:6751:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788940594.676642:0:6751:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa1d8aa9164aa2b37 00010000:00080000:2.0:1788940594.676669:0:6751:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f413f3b6000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.117@tcp at head 00010000:00010000:2.0:1788940594.676888:0:6751:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:3.0:1788940594.769910:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788940594.784225:0:6751:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788940594.784247:0:6751:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788940594.784796:0:6751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940594.784956:0:6751:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940594.784999:0:6751:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788940594.785066:0:6751:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788940594.788503:0:6757:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940594.788511:0:6757:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788940594.795776:0:6751:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788940594.795793:0:6751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788940594.795840:0:6751:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788940594.795863:0:6751:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa1d8aa9164aa2b3e 00000100:00080000:3.0:1788940594.795873:0:6751:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788940594.795885:0:6751:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f413f3b6000 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:3.0:1788940594.795922:0:6751:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4141510000 x1875840068495872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788940594.795943:0:6751:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788940594.796000:0:6751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940594.796004:0:6751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940594.796007:0:6751:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788940594.796024:0:6751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940594.796029:0:6751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940594.796030:0:6751:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788940594.796033:0:6751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788940594.796035:0:6751:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788940594.796081:0:6751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6751:1875840068496000:0@lo:502: 00000100:00100000:3.0:1788940594.796159:0:6751:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940594.796226:0:6751:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110f1b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788940594.796247:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068495872:0@lo:8: 00000100:00100000:3.0:1788940594.796278:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940594.796356:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068496000 00000100:00100000:3.0:1788940594.796363:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068496000 00000100:00100000:3.0:1788940594.796398:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788940594.796407:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:6751:x1875840068496000:12345-0@lo:502: 00000100:00100000:3.0:1788940594.796638:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:6751:x1875840068496000:12345-0@lo:502: Request processed in 231us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940594.796645:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788940594.796684:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068495872 00000100:00100000:3.0:1788940594.796687:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068495872 00000100:00100000:3.0:1788940594.796715:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940594.796719:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1875840068495872:12345-0@lo:8: 00010000:00080000:3.0:1788940594.796740:0:6671:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:3.0:1788940594.796763:0:6671:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa1d8aa9164aa2b45 00002000:00100000:3.0:1788940594.796788:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f41113bc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788940594.796792:0:6671:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788940594.796795:0:6671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788940594.796913:0:6671:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788940594.797042:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788940594.797075:0:6671:0:(import.c:65:import_set_state_nolock()) ffff8f41113bb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940594.797112:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875840068495872:12345-0@lo:8: Request processed in 391us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940594.797118:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788940594.797152:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4141510000 x1875840068495872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940594.797161:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788940594.797167:0:3300:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788940594.797173:0:3300:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788940594.797178:0:3300:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788940594.797180:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f413f3b6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788940594.797210:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788940594.797216:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068495872:0@lo:8: 00000100:00100000:3.0:1788940594.797242:0:6751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:6751:1875840068496000:0@lo:502: 00000020:01000000:3.0:1788940594.797266:0:6751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940594.797271:0:6751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940594.797273:0:6751:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788940594.797283:0:6751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788940594.797393:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788940594.797410:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788940594.797418:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b29 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940594.797429:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b29 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940594.797439:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788940594.797442:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f4118288000 from 1 10000000:01000000:3.0:1788940594.797444:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788940594.797465:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940594.797473:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940594.797481:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940594.797494:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068496384:0@lo:101: 00000100:00100000:3.0:1788940594.797522:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940594.797537:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110f1b780 going to sleep for 11 seconds 00000004:00080000:3.0:1788940594.797550:0:6757:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788940594.797635:0:6757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 236101446948ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788940594.797900:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068496128:0@lo:400: 00000100:00100000:2.0:1788940594.797935:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940594.797974:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940594.797988:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068496256:0@lo:400: 00000100:00100000:2.0:1788940594.798013:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940594.798046:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068496384 00000100:00100000:2.0:1788940594.800081:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068496384 00000100:00100000:2.0:1788940594.800143:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788940594.800152:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4107279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068496384:12345-0@lo:101: 00010000:00010000:2.0:1788940594.800168:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940594.800211:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6200/0xa1d8aa9164aa2b53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2b4c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940594.800237:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6200/0xa1d8aa9164aa2b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b4c expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940594.800249:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc6200/0xa1d8aa9164aa2b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b4c expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940594.800257:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6200, rc 0) 00000100:00100000:2.0:1788940594.800312:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4107279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068496384:12345-0@lo:101: Request processed in 162us (2790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940594.800318:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788940594.800411:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068496128 00000100:00100000:2.0:1788940594.800418:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068496128 00000100:00100000:2.0:1788940594.800443:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068496256 00000100:00100000:2.0:1788940594.800445:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068496256 00000100:00100000:2.0:1788940594.800464:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940594.800470:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068496128:12345-0@lo:400: 00000100:00100000:2.0:1788940594.800504:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068496128:12345-0@lo:400: Request processed in 34us (2569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940594.800510:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940594.800527:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940594.800532:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068496256:12345-0@lo:400: 00000100:00100000:2.0:1788940594.800751:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068496256:12345-0@lo:400: Request processed in 219us (2737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940594.800757:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940594.800987:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068496384:0@lo:101: 00010000:00010000:2.0:1788940594.801009:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b53 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940594.801020:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2b53 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940594.801152:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068496512:0@lo:501: 00000100:00100000:2.0:1788940594.801598:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940594.801637:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114fe180 going to sleep for 11 seconds 00000100:00080000:2.0:1788940594.802129:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788940594.802159:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4141513b80 x1875840068496256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940594.802172:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068496256:0@lo:400: 00010000:00080000:2.0:1788940594.802302:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4141510e00 x1875840068496128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940594.802312:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068496128:0@lo:400: 00000100:00100000:2.0:1788940594.802340:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068496512 00000100:00100000:2.0:1788940594.802345:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068496512 00000100:00100000:2.0:1788940594.802374:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788940594.802381:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410727b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068496512:12345-0@lo:501: 00000100:00100000:2.0:1788940594.802755:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410727b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068496512:12345-0@lo:501: Request processed in 373us (1157us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940594.802762:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788940594.802799:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068496512:0@lo:501: 10000000:01000000:2.0:1788940594.802824:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788940594.802831:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b53 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940594.802841:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b53 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788940594.888944:0:6759:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788940594.888977:0:6759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6759:1875840068496768:0@lo:7: 00000100:00100000:3.0:1788940594.889040:0:6759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940594.889097:0:6759:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110f1be40 going to sleep for 11 seconds 00000004:00080000:3.0:1788940594.889136:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788940594.889176:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068496640:0@lo:13: 00000100:00100000:3.0:1788940594.889226:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940594.889262:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068496768 00000100:00100000:3.0:1788940594.889269:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068496768 00000100:00100000:3.0:1788940594.889326:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940594.889334:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6759:x1875840068496768:12345-0@lo:7: 00000100:00100000:1.0:1788940594.889511:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068496640 00000100:00100000:1.0:1788940594.889515:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068496640 00000100:00100000:1.0:1788940594.889542:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940594.889549:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875840068496640:12345-0@lo:13: 00002000:00000024:1.0:1788940594.889573:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788940594.889622:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875840068496640:12345-0@lo:13: Request processed in 74us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940594.889629:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788940594.890392:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788940594.904656:0:6674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788940594.904664:0:6674:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788940594.904842:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6759:x1875840068496768:12345-0@lo:7: Request processed in 15504us (15797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940594.904853:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788940594.904920:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4141510000 x1875840068496640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940594.904945:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068496640:0@lo:13: 00010000:00080000:1.0:1788940594.905011:0:6759:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4141513800 x1875840068496768/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788940610 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940594.905021:0:6759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6759:1875840068496768:0@lo:7: 00000004:00080000:1.0:1788940594.905030:0:6759:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788940594.905072:0:6759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a044a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6759:1875840068496896:0@lo:5: 00000100:00100000:1.0:1788940594.905104:0:6759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940594.905149:0:6759:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41112a49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940594.906597:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068496896 00000100:00100000:3.0:1788940594.906609:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068496896 00000100:00100000:3.0:1788940594.906667:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940594.906676:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6759:x1875840068496896:12345-0@lo:5: 00002000:00080000:3.0:1788940594.906707:0:6673:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788940594.906711:0:6673:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788940594.907048:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a045c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6759:x1875840068496896:12345-0@lo:5: Request processed in 373us (1942us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788940594.907068:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788940594.907159:0:6759:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f413a044a80 x1875840068496896/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940610 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940594.907176:0:6759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a044a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6759:1875840068496896:0@lo:5: 00000004:00080000:1.0:1788940594.907205:0:6759:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788940594.907241:0:6759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a045f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6759:1875840068497024:0@lo:700: 00000100:00100000:1.0:1788940594.907287:0:6759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940594.907319:0:6759:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41112a49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940594.907991:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068497024 00000100:00100000:3.0:1788940594.907996:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068497024 00000100:00100000:3.0:1788940594.908028:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940594.908035:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6759:x1875840068497024:12345-0@lo:700: 00000100:00100000:3.0:1788940594.908083:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6680:1875840068497152:0@lo:700: 00000100:00100000:3.0:1788940594.908112:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940594.908128:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110f1bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940594.908722:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068497152 00000100:00100000:1.0:1788940594.908727:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068497152 00000100:00100000:1.0:1788940594.908862:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940594.908871:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6680:x1875840068497152:12345-0@lo:700: 40000000:02000000:0.0:1788940594.940130:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788940594.953702:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6680:x1875840068497152:12345-0@lo:700: Request processed in 44820us (45576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940594.953726:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788940594.955616:0:6680:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4141510000 x1875840068497152/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788940610 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940594.955634:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6680:1875840068497152:0@lo:700: 40000000:02000000:1.0:1788940594.955649:0:6680:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:3.0:1788940595.012931:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788940595.012958:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788940595.013115:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6759:x1875840068497024:12345-0@lo:700: Request processed in 105075us (105821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940595.013150:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788940595.013269:0:6759:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f413a045f80 x1875840068497024/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788940610 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940595.013280:0:6759:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788940595.013297:0:6759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a045f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6759:1875840068497024:0@lo:700: 00000004:02000040:3.0:1788940595.037355:0:6759:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788940595.040665:0:6759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6759:1875840068497280:0@lo:5: 00000100:00100000:3.0:1788940595.040734:0:6759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940595.040840:0:6759:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110f1bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940595.040886:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068497280 00000100:00100000:0.0:1788940595.040893:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068497280 00000100:00100000:0.0:1788940595.040976:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788940595.040987:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6759:x1875840068497280:12345-0@lo:5: 00002000:00080000:2.0:1788940595.046013:0:6674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788940595.046035:0:6674:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788940595.049231:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6759:x1875840068497280:12345-0@lo:5: Request processed in 8238us (8490us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788940595.049249:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788940595.049524:0:6759:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4141511880 x1875840068497280/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940611 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940595.049542:0:6759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6759:1875840068497280:0@lo:5: 00000004:00080000:3.0:1788940595.049593:0:6759:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788940595.793262:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940596.809391:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940597.832331:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940598.856286:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940599.821627:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068497408:0@lo:400: 00000100:00100000:1.0:1788940599.821711:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940599.828213:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940599.828236:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068497792:0@lo:400: 00000100:00100000:1.0:1788940599.828317:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940599.828387:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068497408 00000100:00100000:1.0:1788940599.828396:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068497408 00000100:00100000:1.0:1788940599.828449:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788940599.828454:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068497792 00000100:00100000:1.0:1788940599.828458:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:3304:x1875840068497408:12345-0@lo:400: 00000100:00100000:1.0:1788940599.828518:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:3304:x1875840068497408:12345-0@lo:400: Request processed in 61us (6807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940599.828526:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788940599.828576:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068497408:0@lo:400: 00000100:00100000:1.0:1788940599.828620:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068497536:0@lo:400: 00000100:00100000:1.0:1788940599.828654:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940599.828687:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940599.828693:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068497664:0@lo:400: 00000100:00100000:1.0:1788940599.828715:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940599.828828:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068497792 00000100:00100000:2.0:1788940599.828874:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940599.828882:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875840068497792:12345-0@lo:400: 00000100:00100000:2.0:1788940599.828925:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875840068497792:12345-0@lo:400: Request processed in 44us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940599.828932:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788940599.828956:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940599.829246:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068497536 00000100:00100000:2.0:1788940599.829251:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068497536 00000100:00100000:2.0:1788940599.829275:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068497664 00000100:00100000:2.0:1788940599.829277:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068497664 00000100:00100000:2.0:1788940599.829295:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940599.829302:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068497536:12345-0@lo:400: 00000100:00100000:2.0:1788940599.829336:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068497536:12345-0@lo:400: Request processed in 34us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940599.829342:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940599.829353:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940599.829832:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068497664:12345-0@lo:400: 00000100:00100000:2.0:1788940599.829871:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068497664:12345-0@lo:400: Request processed in 512us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940599.829878:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788940599.829910:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788940599.830950:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f41129dea00 x1875840068497664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940599.830966:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068497664:0@lo:400: 00010000:00080000:1.0:1788940599.830982:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f41129dc380 x1875840068497536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940599.830990:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068497536:0@lo:400: 00010000:00080000:1.0:1788940599.831046:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f41129df480 x1875840068497792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940599.831057:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068497792:0@lo:400: 00010000:00010000:3.0:1788940599.881563:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940600.328519:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068497920:0@lo:13: 00000100:00100000:0.0:1788940600.328597:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940600.328702:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068497920 00000100:00100000:0.0:1788940600.328710:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068497920 00000100:00100000:0.0:1788940600.328758:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940600.328766:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875840068497920:12345-0@lo:13: 00002000:00000024:0.0:1788940600.328815:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940600.328863:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875840068497920:12345-0@lo:13: Request processed in 97us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940600.328871:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788940600.328913:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f41129de300 x1875840068497920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940600.328932:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068497920:0@lo:13: 00000001:00080000:3.0:1788940600.441902:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:3.0:1788940600.754902:0:7041:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg217-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788940600.905513:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940601.929479:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940602.960088:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940603.982346:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940604.936671:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068498304:0@lo:400: 00000100:00100000:0.0:1788940604.936758:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940604.936836:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068498176:0@lo:400: 00000100:00100000:3.0:1788940604.936865:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940604.936902:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940604.936908:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068498048:0@lo:400: 00000100:00100000:3.0:1788940604.936933:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940604.937892:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068498432:0@lo:400: 00000100:00100000:1.0:1788940604.937940:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940604.938434:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068498432 00000100:00100000:3.0:1788940604.938443:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068498432 00000100:00100000:3.0:1788940604.938500:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940604.938509:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068498432:12345-0@lo:400: 00000100:00100000:3.0:1788940604.938561:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068498432:12345-0@lo:400: Request processed in 53us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940604.938568:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788940604.938646:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4134691f80 x1875840068498432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940604.938658:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788940604.938673:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068498432:0@lo:400: 00000100:00100000:3.0:1788940604.939261:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068498048 00000100:00100000:3.0:1788940604.939268:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068498048 00000100:00100000:3.0:1788940604.939301:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788940604.939309:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:3302:x1875840068498048:12345-0@lo:400: 00000100:00100000:3.0:1788940604.939366:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:3302:x1875840068498048:12345-0@lo:400: Request processed in 58us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940604.939372:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788940604.939404:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068498304 00000100:00100000:3.0:1788940604.939408:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068498304 00000100:00100000:3.0:1788940604.939433:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068498176 00000100:00100000:3.0:1788940604.939437:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068498176 00000100:00100000:3.0:1788940604.939451:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940604.939457:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068498304:12345-0@lo:400: 00000100:00080000:2.0:1788940604.940140:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940604.940145:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940604.940160:0:5835:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788940604.940169:0:5835:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788940604.947070:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068498304:12345-0@lo:400: Request processed in 7601us (10302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940604.947087:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940604.947128:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940604.947144:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068498176:12345-0@lo:400: 00000100:00100000:3.0:1788940604.951861:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068498176:12345-0@lo:400: Request processed in 4715us (14985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940604.951876:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940604.951941:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068498048:0@lo:400: 00010000:00080000:3.0:1788940604.951966:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4134693100 x1875840068498176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940604.951980:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068498176:0@lo:400: 00010000:00080000:0.0:1788940604.958758:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4134692d80 x1875840068498304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940604.958780:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068498304:0@lo:400: 00010000:00010000:0.0:1788940605.003846:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940605.457919:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068498560:0@lo:13: 00000100:00100000:3.0:1788940605.458001:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940605.458074:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068498560 00000100:00100000:3.0:1788940605.458082:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068498560 00000100:00100000:3.0:1788940605.458124:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940605.458131:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068498560:12345-0@lo:13: 00002000:00000024:3.0:1788940605.458162:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940605.458224:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068498560:12345-0@lo:13: Request processed in 92us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940605.458231:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788940605.458278:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4141513800 x1875840068498560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940605.458296:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068498560:0@lo:13: 00010000:00010000:1.0:1788940606.056330:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940607.048525:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940608.072472:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940609.096690:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940610.057710:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068498944:0@lo:400: 00000100:00100000:2.0:1788940610.057783:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940610.057844:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940610.057851:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068498816:0@lo:400: 00000100:00100000:2.0:1788940610.057875:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940610.057908:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068498944 00000100:00100000:2.0:1788940610.057926:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068498944 00000100:00100000:2.0:1788940610.057976:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068498816 00000100:00100000:2.0:1788940610.057979:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068498816 00000100:00100000:2.0:1788940610.058013:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940610.058021:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068498944:12345-0@lo:400: 00000100:00100000:2.0:1788940610.058074:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068498944:12345-0@lo:400: Request processed in 52us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940610.058081:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940610.058096:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788940610.058103:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068498816:12345-0@lo:400: 00000100:00100000:2.0:1788940610.058129:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068498816:12345-0@lo:400: Request processed in 27us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940610.058135:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788940610.058153:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788940610.058182:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4134692680 x1875840068498816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940610.058215:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068498816:0@lo:400: 00010000:00080000:2.0:1788940610.058227:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4134691180 x1875840068498944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940610.058235:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068498944:0@lo:400: 00000100:00100000:3.0:1788940610.058335:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068498688:0@lo:400: 00000100:00100000:3.0:1788940610.058372:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940610.058405:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940610.058411:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068499072:0@lo:400: 00000100:00100000:3.0:1788940610.058448:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940610.058789:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068498688 00000100:00100000:2.0:1788940610.058794:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068498688 00000100:00100000:2.0:1788940610.058828:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788940610.058835:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:3302:x1875840068498688:12345-0@lo:400: 00000100:00100000:2.0:1788940610.058874:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:3302:x1875840068498688:12345-0@lo:400: Request processed in 39us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940610.058881:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788940610.058907:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068499072 00000100:00100000:2.0:1788940610.058921:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068499072 00000100:00100000:2.0:1788940610.058965:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940610.058971:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068499072:12345-0@lo:400: 00000100:00100000:2.0:1788940610.059004:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141513800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068499072:12345-0@lo:400: Request processed in 34us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940610.059010:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788940610.059026:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940610.059048:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4134692d80 x1875840068499072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940610.059058:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068499072:0@lo:400: 00000100:00100000:2.0:1788940610.059067:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068498688:0@lo:400: 00010000:00010000:0.0:1788940610.120648:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940610.568725:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940610.568751:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068499200:0@lo:13: 00000100:00100000:0.0:1788940610.569578:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940610.570017:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068499200 00000100:00100000:2.0:1788940610.570027:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068499200 00000100:00100000:2.0:1788940610.570073:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940610.570082:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068499200:12345-0@lo:13: 00002000:00000024:2.0:1788940610.570115:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940610.570168:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068499200:12345-0@lo:13: Request processed in 87us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940610.570175:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788940610.570325:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4141513b80 x1875840068499200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940610.570345:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068499200:0@lo:13: 00010000:00010000:3.0:1788940611.146544:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940612.170641:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940613.192401:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940614.220570:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940615.177512:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068499328:0@lo:400: 00000100:00100000:0.0:1788940615.177608:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940615.177686:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940615.177693:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068499456:0@lo:400: 00000100:00100000:0.0:1788940615.177723:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940615.177758:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068499584:0@lo:400: 00000100:00100000:0.0:1788940615.177783:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940615.177823:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940615.177828:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068499712:0@lo:400: 00000100:00100000:0.0:1788940615.177857:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940615.177938:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068499456 00000100:00100000:0.0:1788940615.177949:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068499456 00000100:00100000:0.0:1788940615.178017:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068499584 00000100:00100000:0.0:1788940615.178020:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068499584 00000100:00100000:0.0:1788940615.178056:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940615.178068:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068499456:12345-0@lo:400: 00000100:00100000:0.0:1788940615.178163:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068499456:12345-0@lo:400: Request processed in 98us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940615.178171:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940615.178400:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940615.178424:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068499584:12345-0@lo:400: 00000100:00100000:0.0:1788940615.178461:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068499584:12345-0@lo:400: Request processed in 40us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940615.178466:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940615.178490:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068499712 00000100:00100000:0.0:1788940615.178493:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068499712 00000100:00100000:0.0:1788940615.178520:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788940615.178526:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068499712:12345-0@lo:400: 00000100:00100000:0.0:1788940615.178553:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068499712:12345-0@lo:400: Request processed in 28us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940615.178557:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788940615.178576:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940615.178581:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788940615.178616:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4111330a80 x1875840068499712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940615.178633:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068499712:0@lo:400: 00010000:00080000:0.0:1788940615.178642:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4141511880 x1875840068499584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940615.178649:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068499584:0@lo:400: 00010000:00080000:0.0:1788940615.178680:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4141513b80 x1875840068499456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940615.178687:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068499456:0@lo:400: 00000100:00100000:3.0:1788940615.179733:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068499328 00000100:00100000:3.0:1788940615.179747:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068499328 00000100:00100000:3.0:1788940615.179823:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788940615.179832:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:3303:x1875840068499328:12345-0@lo:400: 00000100:00100000:3.0:1788940615.179928:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:3303:x1875840068499328:12345-0@lo:400: Request processed in 97us (2321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940615.179936:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788940615.182414:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068499328:0@lo:400: 00000020:01000004:2.0:1788940615.237976:0:7614:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788940615.237982:0:7614:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788940615.238521:0:7614:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f413f3b7800 00000020:01000004:2.0:1788940615.238542:0:7614:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788940615.238559:0:7614:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788940615.238578:0:7614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f41412999c0) 00000020:00000080:2.0:1788940615.238602:0:7614:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00010000:00010000:0.0:1788940615.245258:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788940615.312806:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788940615.313104:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788940615.372520:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788940615.392937:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788940615.392990:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788940615.393056:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788940615.393088:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788940615.393602:0:7614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788940615.393621:0:7614:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788940615.393636:0:7614:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa1d8aa9164aa2b61 00000020:01000004:0.0:1788940615.393647:0:7614:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788940615.393676:0:7614:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.117@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788940615.393681:0:7614:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788940615.393687:0:7614:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788940615.393717:0:7614:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788940615.393722:0:7614:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.117@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788940615.478817:0:7614:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.117@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788940615.480945:0:7614:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.117@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788940615.480956:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788940615.480958:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788940615.480960:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940615.480961:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940615.480963:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940615.480964:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940615.480966:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940615.480967:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788940615.480969:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788940615.480971:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940615.480973:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940615.480979:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788940615.480981:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788940615.480983:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788940615.480985:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940615.480986:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940615.480987:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940615.480988:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940615.480989:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940615.480990:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788940615.480991:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788940615.480992:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940615.480993:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940615.481039:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788940615.481076:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111330000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068499840:0@lo:253: 00000100:00100000:3.0:1788940615.481716:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940615.482029:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411133ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940615.493558:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068499840 00000100:00100000:2.0:1788940615.493609:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068499840 00000100:00100000:2.0:1788940615.493697:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788940615.493710:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:7614:x1875840068499840:12345-0@lo:253: 20000000:01000000:2.0:1788940615.493769:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788940615.493775:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788940615.493782:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788940615.493787:0:5828:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788940615.495093:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940615.495389:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788940615.495406:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788940615.495468:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788940615.495477:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788940615.495507:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788940615.495570:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788940615.496029:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788940615.496055:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.117@tcp 20000000:01000000:2.0:1788940615.496057:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.117@tcp (null) (null) (null) 00000040:00080000:2.0:1788940615.496092:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788940615.496100:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788940615.496149:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788940615.496158:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.117@tcp (null) (null) 00000040:00080000:2.0:1788940615.496230:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788940615.496241:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788940615.496273:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788940615.496322:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788940615.507383:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788940615.507430:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.117@tcp 20000000:01000000:2.0:1788940615.507433:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.117@tcp (null) (null) (null) 00000040:00080000:2.0:1788940615.507476:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788940615.507484:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788940615.507517:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788940615.507534:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.117@tcp (null) (null) 00000040:00080000:2.0:1788940615.507572:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788940615.507583:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788940615.507635:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788940615.507674:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788940615.507700:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788940615.507704:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788940615.507714:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788940615.507716:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788940615.507718:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788940615.507738:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788940615.507741:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788940615.507816:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788940615.507820:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788940615.512500:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788940615.512644:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788940615.512681:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788940615.523629:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788940615.523704:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788940615.523833:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788940615.523877:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788940615.523880:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788940615.525252:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788940615.525341:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788940615.525392:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788940615.525847:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788940615.525906:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788940615.525940:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788940615.525955:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788940615.525959:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788940615.529149:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788940615.529631:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788940615.529684:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788940615.529768:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788940615.529783:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788940615.529799:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788940615.534363:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788940615.534482:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788940615.534542:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788940615.535643:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788940615.535693:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788940615.535771:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1788940615.535877:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788940615.535906:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.535930:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2ab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ab2 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.535940:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa2ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2adc expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.535947:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa2b0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b06 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.535954:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4113b37800/0xa1d8aa9164aa2b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b22 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.535984:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f412bfc6200/0xa1d8aa9164aa2b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b4c expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.535993:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.536047:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f412bfc6200/0xa1d8aa9164aa2b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2b4c expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.536064:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f412bfc6200/0xa1d8aa9164aa2b53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b4c expref: 16 pid: 5828 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940615.536082:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111333100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1875840068499968:0@lo:104: 00000100:00100000:3.0:1788940615.536176:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940615.536307:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4113b37800/0xa1d8aa9164aa2b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2b22 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.536316:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4113b37800/0xa1d8aa9164aa2b29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b22 expref: 16 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940615.536325:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111332d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1875840068500096:0@lo:104: 00010000:00010000:3.0:1788940615.536372:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa2b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2b06 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.536380:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa2b0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b06 expref: 16 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940615.536388:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111331f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1875840068500224:0@lo:104: 00010000:00010000:3.0:1788940615.536412:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa2ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2adc expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.536427:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa2ae3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2adc expref: 16 pid: 5826 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940615.536437:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111331880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1875840068500352:0@lo:104: 00010000:00010000:3.0:1788940615.536464:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2ab2 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.536473:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2ab9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ab2 expref: 16 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940615.536480:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111332680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1875840068500480:0@lo:104: 00000100:00100000:3.0:1788940615.536497:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411133b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940615.540391:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788940615.540460:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.540510:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.540523:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.540534:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.540555:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068499968 00000100:00100000:2.0:1788940615.540566:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068499968 00000100:00100000:2.0:1788940615.540619:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068500096 00000100:00100000:2.0:1788940615.540622:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068500096 00000100:00100000:2.0:1788940615.540633:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068500224 00000100:00100000:2.0:1788940615.540635:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068500224 00000100:00100000:2.0:1788940615.540644:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068500352 00000100:00100000:2.0:1788940615.540646:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068500352 00000100:00100000:2.0:1788940615.540655:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068500480 00000100:00100000:2.0:1788940615.540657:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068500480 00000100:00100000:2.0:1788940615.540669:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940615.540699:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f585850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+7:5828:x1875840068499968:12345-0@lo:104: 00010000:00010000:2.0:1788940615.540724:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2b53 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.540839:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788940615.540846:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f585850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+7:5828:x1875840068499968:12345-0@lo:104: Request processed in 150us (4671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940615.540854:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940615.540910:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940615.540921:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+6:5828:x1875840068500096:12345-0@lo:104: 00010000:00010000:2.0:1788940615.540930:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2b29 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.540970:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788940615.540976:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+6:5828:x1875840068500096:12345-0@lo:104: Request processed in 60us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940615.540984:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940615.540998:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940615.541005:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+5:5828:x1875840068500224:12345-0@lo:104: 00010000:00010000:2.0:1788940615.541014:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2b0d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.541040:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788940615.541044:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+5:5828:x1875840068500224:12345-0@lo:104: Request processed in 42us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940615.541050:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940615.541060:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940615.541065:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+4:5828:x1875840068500352:12345-0@lo:104: 00010000:00010000:2.0:1788940615.541079:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2ae3 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.541110:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788940615.541116:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+4:5828:x1875840068500352:12345-0@lo:104: Request processed in 50us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940615.541122:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788940615.541131:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1788940615.541136:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940615.541143:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:5828:x1875840068500480:12345-0@lo:104: 00010000:00010000:2.0:1788940615.541150:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2ab9 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541155:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2b53 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541167:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37e00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:1.0:1788940615.541173:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2b53 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.541182:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1788940615.541184:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2b53 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940615.541213:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:5828:x1875840068500480:12345-0@lo:104: Request processed in 70us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940615.541229:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 10000000:00010000:1.0:1788940615.541230:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2b53 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940615.541239:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940615.541249:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788940615.541290:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b53 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541298:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940615.541322:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b53 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541331:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2b4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b53 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541345:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788940615.541349:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2b0d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541356:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:1.0:1788940615.541359:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2b0d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541378:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2b0d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940615.541387:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2b0d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940615.541394:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788940615.541410:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b0d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541417:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940615.541423:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b0d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.541428:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940615.541431:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6e00/0xa1d8aa9164aa2b06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b0d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.541437:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2b29 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541444:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940615.541448:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030800 already unused, calling callback (ffffffffc1aa9c20) 00010000:00010000:1.0:1788940615.541450:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2ab9 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940615.541454:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2b29 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541463:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7e00 already unused, calling callback (ffffffffc1aa9c20) 00010000:00010000:2.0:1788940615.541471:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2b29 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940615.541471:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2ab9 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541489:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2ab9 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940615.541491:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2b29 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940615.541498:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2ab9 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940615.541506:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940615.541516:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940615.541530:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b29 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541536:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2ab9 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.541537:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940615.541546:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940615.541557:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b29 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541560:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2ab9 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.541573:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4100030800/0xa1d8aa9164aa2b22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b29 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541575:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2ab2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2ab9 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.541597:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940615.541599:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940615.541601:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940615.541602:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940615.541606:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940615.541607:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940615.541627:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068500736:0@lo:103: 00000100:00100000:1.0:1788940615.541679:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.541688:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068500864:0@lo:103: 00000100:00100000:2.0:1788940615.541722:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940615.541736:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940615.541745:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068500608:0@lo:103: 00000100:00100000:2.0:1788940615.541748:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940615.541757:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068500992:0@lo:103: 00000100:00100000:1.0:1788940615.541777:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.541814:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068500736 00000100:00100000:2.0:1788940615.541820:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068500736 00000100:00100000:1.0:1788940615.541837:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068500864 00000100:00100000:1.0:1788940615.541843:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068500864 00010000:00010000:2.0:1788940615.541848:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa2b0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b06 expref: 17 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541875:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4113b37800/0xa1d8aa9164aa2b29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b22 expref: 18 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940615.541886:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068500608 00000100:00100000:2.0:1788940615.541891:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068500608 00000100:00100000:1.0:1788940615.541900:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788940615.541908:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f412bfc6200/0xa1d8aa9164aa2b53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b4c expref: 19 pid: 5828 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940615.541911:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068500736:12345-0@lo:103: 00010000:00010000:1.0:1788940615.541930:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788940615.541932:0:5818:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788940615.541938:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa2b0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b06 expref: 19 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940615.541949:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788940615.541962:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa2b0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b06 expref: 19 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.541982:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940615.542016:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a047800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068500736:12345-0@lo:103: Request processed in 109us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940615.542024:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940615.542041:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788940615.542049:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:3301:x1875840068500864:12345-0@lo:103: 00010000:00010000:1.0:1788940615.542058:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940615.542063:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4113b37800/0xa1d8aa9164aa2b29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b22 expref: 18 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.542072:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4113b37800/0xa1d8aa9164aa2b29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b22 expref: 18 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940615.542078:0:5817:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788940615.542083:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940615.542092:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940615.542102:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a045500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:3304:x1875840068500608:12345-0@lo:103: 00000100:00100000:1.0:1788940615.542110:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:3301:x1875840068500864:12345-0@lo:103: Request processed in 62us (388us total) trans 0 rc 0/0 00010000:00010000:2.0:1788940615.542113:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788940615.542119:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788940615.542122:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f412bfc6200/0xa1d8aa9164aa2b53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b4c expref: 18 pid: 5828 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.542136:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f412bfc6200/0xa1d8aa9164aa2b53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b4c expref: 17 pid: 5828 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.542147:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940615.542164:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068500736:0@lo:103: 00000100:00100000:2.0:1788940615.542179:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a045500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:3304:x1875840068500608:12345-0@lo:103: Request processed in 78us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940615.542218:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940615.542222:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068500608:0@lo:103: 00000100:00100000:2.0:1788940615.542246:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.542285:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068500864:0@lo:103: 00010000:00010000:3.0:1788940615.542499:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc6200/0xa1d8aa9164aa2b53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b4c expref: 16 pid: 5828 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940615.542514:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111333100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1875840068499968:0@lo:104: 00010000:00010000:3.0:1788940615.542524:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4113b37800/0xa1d8aa9164aa2b29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b22 expref: 15 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940615.542534:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111332d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1875840068500096:0@lo:104: 00010000:00010000:3.0:1788940615.542544:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa2b0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b06 expref: 14 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940615.542552:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111331f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1875840068500224:0@lo:104: 00000100:00100000:3.0:1788940615.542561:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111331880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1875840068500352:0@lo:104: 00000100:00100000:3.0:1788940615.542569:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111332680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5828:1875840068500480:0@lo:104: 00010000:00010000:3.0:1788940615.542606:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940615.542744:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068500992 00000100:00100000:2.0:1788940615.542749:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068500992 00010000:00010000:2.0:1788940615.542769:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2ab9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ab2 expref: 14 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940615.542887:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940615.542895:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:3301:x1875840068500992:12345-0@lo:103: 00010000:00010000:2.0:1788940615.542905:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940615.542911:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2ab9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ab2 expref: 14 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.542920:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ab2 expref: 14 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.542946:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2ab9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ab2 expref: 14 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.542957:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940615.542992:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:3301:x1875840068500992:12345-0@lo:103: Request processed in 98us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940615.542999:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940615.543063:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068500992:0@lo:103: 00010000:00010000:1.0:1788940615.544390:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940615.544400:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940615.544403:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940615.544581:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2ae3 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.544598:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050c00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:2.0:1788940615.544602:0:7620:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2ae3 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.544612:0:7620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2ae3 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940615.544621:0:7620:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2ae3 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940615.544628:0:7620:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788940615.544734:0:7620:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2ae3 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.544742:0:7620:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940615.544774:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2ae3 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.544804:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4142050c00/0xa1d8aa9164aa2adc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2ae3 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940615.544847:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068501120:0@lo:103: 00000100:00100000:2.0:1788940615.544938:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940615.544998:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940615.545000:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940615.545003:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940615.545064:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068501120 00000100:00100000:1.0:1788940615.545072:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068501120 00010000:00010000:1.0:1788940615.545110:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa2ae3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2adc expref: 13 pid: 5826 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940615.545151:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940615.545162:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:3303:x1875840068501120:12345-0@lo:103: 00010000:00010000:1.0:1788940615.545179:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940615.545213:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa2ae3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2adc expref: 13 pid: 5826 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.545226:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa2ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2adc expref: 13 pid: 5826 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.545240:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa2ae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2adc expref: 13 pid: 5826 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.545258:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.545268:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.545287:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.545294:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.545301:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.545308:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.545324:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940615.545328:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.545336:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.545353:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.545364:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940615.545410:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:3303:x1875840068501120:12345-0@lo:103: Request processed in 250us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940615.545418:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940615.545460:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068501120:0@lo:103: 00010000:00010000:3.0:1788940615.545638:0:5828:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.545649:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.545655:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2b68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788940615.545673:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788940615.660876:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:7614:x1875840068499840:12345-0@lo:253: Request processed in 167143us (179136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940615.660897:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788940615.661069:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111330000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068499840:0@lo:253: 10000000:01000000:2.0:1788940615.661092:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788940615.661096:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788940615.661098:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788940615.661100:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940615.661101:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788940615.661102:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940615.661104:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940615.661105:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940615.661107:0:7614:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788940615.661109:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940615.661110:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788940615.661138:0:7614:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f413f3b7800 from lustre-OST0001 10000000:01000000:2.0:1788940615.661184:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788940615.661218:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788940615.661228:0:7614:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f4118288000 local copy 10000000:01000000:2.0:1788940615.661234:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788940615.661281:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.661295:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.661330:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940615.661354:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068501248:0@lo:101: 00000100:00100000:2.0:1788940615.661403:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.661463:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413623c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788940615.661726:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068501248 00000100:00100000:1.0:1788940615.661735:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068501248 00000100:00100000:1.0:1788940615.665545:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788940615.665576:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:7614:x1875840068501248:12345-0@lo:101: 00010000:00010000:1.0:1788940615.665612:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940615.665640:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4142050600/0xa1d8aa9164aa2b76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2b6f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.665682:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142050600/0xa1d8aa9164aa2b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b6f expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.665696:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4142050600/0xa1d8aa9164aa2b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b6f expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.665733:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050600, rc 0) 00000100:00100000:1.0:1788940615.665848:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:7614:x1875840068501248:12345-0@lo:101: Request processed in 290us (4445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940615.665856:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788940615.666665:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068501248:0@lo:101: 00010000:00010000:2.0:1788940615.666696:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa1d8aa9164aa2b76 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.666709:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa1d8aa9164aa2b76 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940615.667427:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068501376:0@lo:501: 00000100:00100000:2.0:1788940615.667500:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.667557:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413623c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940615.667707:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068501376 00000100:00100000:0.0:1788940615.667716:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068501376 00000100:00100000:0.0:1788940615.667804:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788940615.667816:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:7614:x1875840068501376:12345-0@lo:501: 00000100:00100000:0.0:1788940615.668466:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:7614:x1875840068501376:12345-0@lo:501: Request processed in 650us (962us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940615.668478:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788940615.668604:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068501376:0@lo:501: 10000000:01000000:2.0:1788940615.668628:0:7614:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788940615.668673:0:7614:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788940615.668683:0:7614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa1d8aa9164aa2b76 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.668695:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa1d8aa9164aa2b76 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.668704:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa1d8aa9164aa2b76 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.668742:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788940615.668774:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f413f3b7800 10000000:01000000:2.0:1788940615.668780:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788940615.668787:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788940615.668790:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788940615.668796:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788940615.668800:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788940615.668835:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.668844:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.668866:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940615.668886:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068501504:0@lo:101: 00000100:00100000:2.0:1788940615.668942:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.668980:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413623c9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788940615.669331:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940615.669341:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa1d8aa9164aa2b76 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.669351:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6600 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:3.0:1788940615.669355:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa1d8aa9164aa2b76 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.669364:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa1d8aa9164aa2b76 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940615.669371:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa1d8aa9164aa2b76 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940615.669377:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940615.669403:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa1d8aa9164aa2b76 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.669409:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940615.669450:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa1d8aa9164aa2b76 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.669457:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6600/0xa1d8aa9164aa2b6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa1d8aa9164aa2b76 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.669472:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940615.669474:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940615.669476:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940615.669486:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940615.669500:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068501632:0@lo:103: 00000100:00100000:3.0:1788940615.669542:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940615.669610:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068501632 00000100:00100000:3.0:1788940615.669617:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068501632 00000100:00100000:3.0:1788940615.669668:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940615.669677:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111331880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:3303:x1875840068501632:12345-0@lo:103: 00010000:00010000:3.0:1788940615.669691:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940615.669708:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142050600/0xa1d8aa9164aa2b76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b6f expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.669727:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940615.669763:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111331880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:3303:x1875840068501632:12345-0@lo:103: Request processed in 86us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940615.669770:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940615.669800:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068501632:0@lo:103: 00000100:00100000:0.0:1788940615.670014:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068501504 00000100:00100000:0.0:1788940615.670020:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068501504 00000100:00100000:0.0:1788940615.670064:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788940615.670073:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+11:7614:x1875840068501504:12345-0@lo:101: 00010000:00010000:0.0:1788940615.670086:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940615.670103:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4100031200/0xa1d8aa9164aa2b84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2b7d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.670127:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4100031200/0xa1d8aa9164aa2b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b7d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.670139:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4100031200/0xa1d8aa9164aa2b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b7d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.670145:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100031200, rc 0) 00000100:00100000:0.0:1788940615.670514:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:7614:x1875840068501504:12345-0@lo:101: Request processed in 442us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940615.670520:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788940615.670896:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068501504:0@lo:101: 00010000:00010000:2.0:1788940615.670932:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b84 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.670944:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2b84 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940615.671074:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068501760:0@lo:501: 00000100:00100000:2.0:1788940615.671130:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.671179:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413623c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940615.673271:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068501760 00000100:00100000:0.0:1788940615.673292:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068501760 00000100:00100000:0.0:1788940615.673388:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788940615.673402:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:7614:x1875840068501760:12345-0@lo:501: 00000100:00100000:0.0:1788940615.673849:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:7614:x1875840068501760:12345-0@lo:501: Request processed in 449us (2716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940615.673878:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788940615.674260:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068501760:0@lo:501: 00000100:00100000:2.0:1788940615.674328:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068501888:0@lo:503: 00000100:00100000:2.0:1788940615.674386:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.674425:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413623c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940615.674840:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068501888 00000100:00100000:3.0:1788940615.674848:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068501888 00000100:00100000:3.0:1788940615.674901:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788940615.674909:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:7614:x1875840068501888:12345-0@lo:503: 00000100:00100000:3.0:1788940615.675180:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:7614:x1875840068501888:12345-0@lo:503: Request processed in 271us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940615.675223:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788940615.675529:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068501888:0@lo:503: 00000040:00080000:2.0:1788940615.675958:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788940615.676070:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068502016:0@lo:502: 00000100:00100000:2.0:1788940615.676131:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.676508:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413623c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940615.679879:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068502016 00000100:00100000:1.0:1788940615.679904:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068502016 00000100:00100000:1.0:1788940615.679992:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788940615.680004:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:7614:x1875840068502016:12345-0@lo:502: 00000100:00100000:1.0:1788940615.680439:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:7614:x1875840068502016:12345-0@lo:502: Request processed in 435us (4305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940615.680449:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788940615.680537:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068502016:0@lo:502: 00000040:00080000:1.0:1788940615.681457:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788940615.681563:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788940615.683139:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788940615.683570:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788940615.683623:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788940615.683655:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788940615.683722:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068502144:0@lo:502: 00000100:00100000:1.0:1788940615.683836:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940615.683938:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bfa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940615.684047:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068502144 00000100:00100000:0.0:1788940615.684058:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068502144 00000100:00100000:0.0:1788940615.684152:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788940615.684165:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:7614:x1875840068502144:12345-0@lo:502: 00000100:00100000:0.0:1788940615.684483:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:7614:x1875840068502144:12345-0@lo:502: Request processed in 320us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940615.684492:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788940615.685361:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068502144:0@lo:502: 00000040:00080000:1.0:1788940615.685558:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788940615.685881:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:2.0:1788940615.693171:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068502272:0@lo:13: 00000100:00100000:2.0:1788940615.693303:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940615.693620:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068502272 00000100:00100000:3.0:1788940615.693633:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068502272 00000100:00100000:3.0:1788940615.693706:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940615.693718:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068502272:12345-0@lo:13: 00002000:00000024:3.0:1788940615.693768:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940615.693838:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068502272:12345-0@lo:13: Request processed in 122us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940615.693846:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788940615.694068:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4111332680 x1875840068502272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940631 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940615.694094:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068502272:0@lo:13: 00000020:01000000:1.0:1788940615.696878:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940615.696896:0:7624:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788940615.698042:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940615.698052:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788940615.698073:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940615.698098:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f413f4199c0) 00000020:00000080:1.0:1788940615.698135:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788940615.698155:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788940615.698449:0:7624:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f413f3b7800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788940615.698461:0:7624:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788940615.698470:0:7624:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa1d8aa9164aa2b92 00010000:00010000:1.0:1788940615.708079:0:7624:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788940615.712835:0:7624:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788940615.723703:0:7624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788940615.724549:0:7624:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788940615.734486:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788940615.737825:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788940615.763872:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788940615.763892:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940615.763900:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940615.763903:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788940615.763908:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940615.765454:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940615.765470:0:7624:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788940615.765494:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788940615.765497:0:7624:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788940615.765647:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940615.765652:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940615.765653:0:7624:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788940615.765657:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788940615.771710:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788940615.771773:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788940615.771806:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b84 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.771823:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2b84 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940615.771834:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f413f3b7800 from 1 10000000:01000000:1.0:1788940615.771837:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788940615.771900:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.771910:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.771924:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940615.771957:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068502400:0@lo:101: 00000100:00100000:1.0:1788940615.772050:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940615.774274:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940615.778782:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068502400 00000100:00100000:0.0:1788940615.778807:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068502400 00000100:00100000:0.0:1788940615.782276:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788940615.782320:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:7614:x1875840068502400:12345-0@lo:101: 00010000:00010000:0.0:1788940615.782348:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940615.782373:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4100030e00/0xa1d8aa9164aa2ba0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2b99 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.782413:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4100030e00/0xa1d8aa9164aa2ba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b99 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.782427:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4100030e00/0xa1d8aa9164aa2ba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b99 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.782438:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100030e00, rc 0) 00000100:00100000:0.0:1788940615.782572:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:7614:x1875840068502400:12345-0@lo:101: Request processed in 281us (10522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940615.782590:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788940615.783654:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a046a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068502400:0@lo:101: 00010000:00010000:3.0:1788940615.783687:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ba0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940615.783701:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2ba0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940615.783931:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111332680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068502528:0@lo:501: 00000100:00100000:3.0:1788940615.783994:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940615.785490:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068502528 00000100:00100000:1.0:1788940615.785505:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068502528 00000100:00100000:1.0:1788940615.785563:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788940615.785587:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:7614:x1875840068502528:12345-0@lo:501: 00000100:00100000:1.0:1788940615.785965:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:7614:x1875840068502528:12345-0@lo:501: Request processed in 390us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940615.785974:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788940615.786646:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411133be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940615.786694:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111332680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068502528:0@lo:501: 00000100:00100000:2.0:1788940615.786765:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068502656:0@lo:503: 00000100:00100000:2.0:1788940615.786831:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.786866:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4112bbb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940615.787048:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068502656 00000100:00100000:1.0:1788940615.787055:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068502656 00000100:00100000:1.0:1788940615.787093:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788940615.787101:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:7614:x1875840068502656:12345-0@lo:503: 00000100:00100000:1.0:1788940615.787911:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:7614:x1875840068502656:12345-0@lo:503: Request processed in 805us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940615.787922:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788940615.788065:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068502656:0@lo:503: 00000040:00080000:2.0:1788940615.788725:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788940615.788829:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068502784:0@lo:502: 00000100:00100000:2.0:1788940615.789049:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.789096:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410ac0ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940615.789533:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068502784 00000100:00100000:1.0:1788940615.789542:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068502784 00000100:00100000:1.0:1788940615.789598:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788940615.789609:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:7614:x1875840068502784:12345-0@lo:502: 00000100:00100000:1.0:1788940615.789903:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:7614:x1875840068502784:12345-0@lo:502: Request processed in 294us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940615.789911:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788940615.790102:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068502784:0@lo:502: 00000040:00080000:2.0:1788940615.790703:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788940615.790771:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788940615.790811:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068502912:0@lo:502: 00000100:00100000:2.0:1788940615.790878:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.790915:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410ac0ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940615.790998:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068502912 00000100:00100000:0.0:1788940615.791015:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068502912 00000100:00100000:0.0:1788940615.791074:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788940615.791084:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:7614:x1875840068502912:12345-0@lo:502: 00000100:00100000:0.0:1788940615.791587:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:7614:x1875840068502912:12345-0@lo:502: Request processed in 493us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940615.791597:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788940615.792080:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068502912:0@lo:502: 00000040:00080000:2.0:1788940615.792535:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788940615.792551:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788940615.793487:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940615.793503:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940615.793506:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788940615.793515:0:7628:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f413f3b7800 00000020:00000080:1.0:1788940615.793518:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788940615.793540:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940615.793544:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940615.793553:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788940615.793557:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788940615.793820:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788940615.793846:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940615.793937:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ba0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.793952:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ba0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940615.794003:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788940615.794013:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f413f3b7800 10000000:01000000:2.0:1788940615.794017:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f413f3b7800 10000000:01000000:2.0:1788940615.794022:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788940615.794029:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f413f3b7800 from 1 10000000:01000000:2.0:1788940615.794032:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788940615.794076:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.794085:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.794099:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940615.794126:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068503040:0@lo:101: 00000100:00100000:2.0:1788940615.794337:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.794391:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410ac0a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940615.794460:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068503040 00000100:00100000:0.0:1788940615.794470:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068503040 00000100:00100000:0.0:1788940615.794530:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788940615.794542:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:7614:x1875840068503040:12345-0@lo:101: 00010000:00010000:0.0:1788940615.794560:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940615.794577:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4100031400/0xa1d8aa9164aa2bae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2ba7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.794605:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4100031400/0xa1d8aa9164aa2bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ba7 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.794617:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4100031400/0xa1d8aa9164aa2bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ba7 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.794627:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100031400, rc 0) 00000100:00100000:0.0:1788940615.794684:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:7614:x1875840068503040:12345-0@lo:101: Request processed in 144us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940615.794691:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788940615.795017:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068503040:0@lo:101: 00010000:00010000:2.0:1788940615.795034:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2bae expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.795044:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2bae expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940615.795158:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068503168:0@lo:501: 00000100:00100000:2.0:1788940615.795361:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.795403:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410ac0a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788940615.795467:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068503168 00000100:00100000:1.0:1788940615.795473:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068503168 00000100:00100000:1.0:1788940615.795513:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788940615.795521:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:7614:x1875840068503168:12345-0@lo:501: 00000100:00100000:1.0:1788940615.795815:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:7614:x1875840068503168:12345-0@lo:501: Request processed in 293us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940615.795823:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788940615.795869:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068503168:0@lo:501: 00000100:00100000:1.0:1788940615.795903:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068503296:0@lo:503: 00000100:00100000:1.0:1788940615.795944:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940615.795965:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068503296 00000100:00100000:1.0:1788940615.795969:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068503296 00000100:00100000:1.0:1788940615.795985:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788940615.795990:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:7614:x1875840068503296:12345-0@lo:503: 00000100:00100000:1.0:1788940615.796148:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:7614:x1875840068503296:12345-0@lo:503: Request processed in 157us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940615.796156:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788940615.796208:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940615.796642:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068503296:0@lo:503: 00000040:00080000:1.0:1788940615.797019:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788940615.797100:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068503424:0@lo:502: 00000100:00100000:1.0:1788940615.797463:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940615.797544:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940615.797589:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068503424 00000100:00100000:2.0:1788940615.797597:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068503424 00000100:00100000:2.0:1788940615.797687:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788940615.797707:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:7614:x1875840068503424:12345-0@lo:502: 00000100:00100000:2.0:1788940615.797979:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:7614:x1875840068503424:12345-0@lo:502: Request processed in 272us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940615.797987:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788940615.798072:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068503424:0@lo:502: 00000040:00080000:1.0:1788940615.798466:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788940615.798519:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788940615.798551:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788940615.798598:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788940615.798634:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788940615.798682:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788940615.798718:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788940615.798753:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788940615.798814:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788940615.798871:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788940615.798915:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788940615.798964:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788940615.799001:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788940615.799034:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788940615.799085:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788940615.799120:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788940615.799154:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788940615.799228:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788940615.799263:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788940615.799308:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788940615.799354:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788940615.799387:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788940615.799420:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788940615.799467:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788940615.799502:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788940615.799532:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788940615.799575:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788940615.799606:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788940615.799638:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788940615.799683:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788940615.799717:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788940615.799748:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788940615.799796:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788940615.799845:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788940615.799891:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788940615.799970:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788940615.800009:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788940615.800065:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068503552:0@lo:502: 00000100:00100000:1.0:1788940615.800160:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940615.811655:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940615.814521:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068503552 00000100:00100000:0.0:1788940615.814545:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068503552 00000100:00100000:0.0:1788940615.814654:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788940615.814669:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:7614:x1875840068503552:12345-0@lo:502: 00000100:00100000:0.0:1788940615.815132:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:7614:x1875840068503552:12345-0@lo:502: Request processed in 465us (14971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940615.815159:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788940615.815819:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068503552:0@lo:502: 00000040:00080000:1.0:1788940615.816019:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788940615.816039:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788940615.821092:0:7629:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788940615.821117:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f413f418000) 00000020:00000080:1.0:1788940615.821162:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788940615.821531:0:7629:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f413f3b7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788940615.821537:0:7629:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f413f3b7800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788940615.821540:0:7629:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f413f3b7800 3 00010000:00080000:1.0:1788940615.821582:0:7629:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f413a744000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.117@tcp at head 00010000:00010000:1.0:1788940615.827798:0:7629:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788940615.829092:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788940615.829157:0:7629:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788940615.829175:0:7629:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa1d8aa9164aa2bbc 00000100:00080000:1.0:1788940615.829217:0:7629:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940615.829234:0:7629:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f413a744000 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:1.0:1788940615.829284:0:7629:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f413a047480 x1875840068503680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940615.829318:0:7629:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788940615.829583:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1875840068503680:0@lo:38: 00000100:00100000:3.0:1788940615.829682:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940615.830341:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068503808:0@lo:400: 00000100:00100000:3.0:1788940615.830382:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940615.830431:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068503936:0@lo:400: 00000100:00100000:3.0:1788940615.830457:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940615.830480:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940615.830485:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068504064:0@lo:400: 00000100:00100000:3.0:1788940615.830511:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940615.830545:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068503680 00000100:00100000:3.0:1788940615.830554:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068503680 00000100:00100000:3.0:1788940615.830589:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068503808 00000100:00100000:3.0:1788940615.830593:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068503808 00000100:00100000:3.0:1788940615.830618:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068503936 00000100:00100000:3.0:1788940615.830621:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068503936 00000100:00100000:3.0:1788940615.830638:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940615.830649:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068503808:12345-0@lo:400: 00000100:00100000:3.0:1788940615.830709:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068503808:12345-0@lo:400: Request processed in 62us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940615.830717:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940615.830734:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940615.830740:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068503936:12345-0@lo:400: 00000100:00100000:3.0:1788940615.830769:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068503936:12345-0@lo:400: Request processed in 30us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940615.830776:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940615.830792:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940615.830796:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3300:x1875840068503680:12345-0@lo:38: 00010000:00080000:3.0:1788940615.830831:0:7198:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:3.0:1788940615.830880:0:7198:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa1d8aa9164aa2bc3 00000004:00100000:3.0:1788940615.830900:0:7198:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788940615.830950:0:7198:0:(import.c:65:import_set_state_nolock()) ffff8f413f184000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940615.830993:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875840068503680:12345-0@lo:38: Request processed in 195us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940615.830999:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940615.831019:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068504064 00000100:00100000:3.0:1788940615.831023:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068504064 00000100:00100000:3.0:1788940615.831051:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940615.831057:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068504064:12345-0@lo:400: 00000100:00100000:3.0:1788940615.831091:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068504064:12345-0@lo:400: Request processed in 34us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940615.831096:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1788940615.831525:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:1.0:1788940615.831734:0:7630:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8f413a044000 x1875840068504192/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940615.831757:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bfe40 going to sleep for 0 seconds 00010000:00080000:3.0:1788940615.832028:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f41129df480 x1875840068503808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940615.832046:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068503808:0@lo:400: 00010000:00080000:3.0:1788940615.832100:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f41129dea00 x1875840068504064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940615.832109:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068504064:0@lo:400: 00010000:00080000:3.0:1788940615.832120:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f41129dc380 x1875840068503936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940615.832127:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068503936:0@lo:400: 00000020:01000000:2.0:1788940615.832367:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788940615.832405:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788940615.832431:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2bae expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.832445:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2bae expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788940615.832507:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788940615.832509:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788940615.832511:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940615.832513:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940615.832515:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940615.832516:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940615.832518:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940615.832520:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940615.832522:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940615.832524:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940615.832525:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940615.832530:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788940615.832533:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940615.832534:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788940615.832536:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940615.832537:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940615.832538:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940615.832540:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940615.832541:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940615.832542:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940615.832543:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940615.832544:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940615.832545:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940615.832567:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788940615.832579:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068504320:0@lo:253: 00000100:00100000:2.0:1788940615.832649:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940615.832685:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410ac0ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940615.833481:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068504320 00000100:00100000:0.0:1788940615.833491:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068504320 00000100:00100000:0.0:1788940615.833562:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788940615.833574:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:7614:x1875840068504320:12345-0@lo:253: 20000000:01000000:0.0:1788940615.833609:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788940615.833628:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788940615.834423:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f413a047480 x1875840068503680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940615.834454:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788940615.834466:0:3300:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788940615.834476:0:3300:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788940615.834483:0:3300:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788940615.834487:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f413a744000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788940615.834496:0:3300:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fbb175a4): req@ffff8f413a044000 x1875840068504192/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940615.834513:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1875840068503680:0@lo:38: 00000100:00100000:1.0:1788940615.835452:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940615.835506:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068504192 00000100:00100000:1.0:1788940615.835513:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068504192 00000100:00100000:1.0:1788940615.835568:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940615.835579:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1875840068504192:12345-0@lo:901: 00000100:00100000:1.0:1788940615.836061:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1875840068504192:12345-0@lo:901: Request processed in 482us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940615.836070:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788940615.836123:0:7630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f413a044000 x1875840068504192/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788940631 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940615.836171:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a044000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1875840068504192:0@lo:901: 00000100:00080000:0.0:1788940615.838599:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:0.0:1788940615.948906:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788940615.948945:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788940615.949775:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788940615.949784:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788940615.949818:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.949843:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f412bfc6a00/0xa1d8aa9164aa2b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b14 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.949853:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.950486:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f412bfc6a00/0xa1d8aa9164aa2b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2b14 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940615.950508:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f412bfc6a00/0xa1d8aa9164aa2b1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b14 expref: 14 pid: 5827 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940615.950553:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a044000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875840068504448:0@lo:104: 00000100:00100000:1.0:1788940615.950652:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940615.950738:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940615.951242:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068504448 00000100:00100000:0.0:1788940615.951254:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068504448 00000100:00100000:0.0:1788940615.951342:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940615.951355:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a045f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:5849:x1875840068504448:12345-0@lo:104: 00010000:00010000:0.0:1788940615.951374:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2b1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.951461:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940615.951468:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a045f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:5849:x1875840068504448:12345-0@lo:104: Request processed in 116us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940615.951476:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788940615.951503:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940615.951511:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2b1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.951520:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100031800 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:0.0:1788940615.951525:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2b1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.951551:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2b1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940615.951559:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2b1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940615.951566:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940615.951602:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.951610:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940615.951632:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.951640:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4100031800/0xa1d8aa9164aa2b14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b1b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.951662:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940615.951664:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940615.951666:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940615.951691:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068504576:0@lo:103: 00000100:00100000:0.0:1788940615.951734:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940615.951791:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068504576 00000100:00100000:0.0:1788940615.951795:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068504576 00010000:00010000:0.0:1788940615.951817:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f412bfc6a00/0xa1d8aa9164aa2b1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b14 expref: 15 pid: 5827 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940615.951841:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940615.951848:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4107399450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:3301:x1875840068504576:12345-0@lo:103: 00010000:00010000:0.0:1788940615.951880:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940615.951887:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f412bfc6a00/0xa1d8aa9164aa2b1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b14 expref: 15 pid: 5827 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.951900:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f412bfc6a00/0xa1d8aa9164aa2b1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b14 expref: 15 pid: 5827 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.953118:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.953138:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788940615.953165:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005382423s 00010000:00010000:0.0:1788940615.953172:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.953180:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.953205:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.953213:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.953220:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051800 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940615.953225:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.953233:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.953263:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940615.953284:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940615.953364:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4107399450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:3301:x1875840068504576:12345-0@lo:103: Request processed in 1514us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940615.953375:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940615.953501:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068504576:0@lo:103: 00010000:00010000:2.0:1788940615.954866:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc6a00/0xa1d8aa9164aa2b1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b14 expref: 14 pid: 5827 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940615.954892:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a044000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875840068504448:0@lo:104: 00010000:00010000:2.0:1788940615.954932:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.954944:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.954951:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940615.954958:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2bca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940616.006897:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:7614:x1875840068504320:12345-0@lo:253: Request processed in 173309us (174230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940616.007092:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7614:1875840068504320:0@lo:253: 10000000:01000000:2.0:1788940616.007113:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788940616.007116:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788940616.007118:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788940616.007121:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940616.007122:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940616.007124:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940616.007126:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940616.007127:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940616.007129:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788940616.007130:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788940616.007132:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940616.007133:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788940616.007170:0:7614:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788940616.008301:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00080000:10000000:2.0:1788940616.016087:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940616.017035:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788940616.020119:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788940616.020573:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788940616.020901:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940616.022675:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788940616.026483:0:7614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1788940616.268989:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788940616.479276:0:7614:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788940616.479289:0:7614:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788940616.479335:0:7614:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788940616.479417:0:7614:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.117@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788940616.479447:0:7614:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788940616.479488:0:7614:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788940617.290554:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940618.312674:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940619.354315:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940620.361836:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940620.817302:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068504704:0@lo:13: 00000100:00100000:1.0:1788940620.817379:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940620.818273:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068504704 00000100:00100000:2.0:1788940620.818286:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068504704 00000100:00100000:2.0:1788940620.818364:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940620.818374:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068504704:12345-0@lo:13: 00002000:00000024:2.0:1788940620.818414:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788940620.818506:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940620.823511:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a044a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068504704:12345-0@lo:13: Request processed in 5131us (6125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940620.823526:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788940620.823648:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41129dc700 x1875840068504704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940636 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940620.823673:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068504704:0@lo:13: 00000100:00100000:1.0:1788940621.324550:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068504832:0@lo:400: 00000100:00100000:1.0:1788940621.324624:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940621.324678:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940621.324684:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068504960:0@lo:400: 00000100:00100000:1.0:1788940621.324725:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940621.324767:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068505088:0@lo:400: 00000100:00100000:1.0:1788940621.324790:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940621.324821:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940621.324826:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068505216:0@lo:400: 00000100:00100000:1.0:1788940621.324849:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940621.324896:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068504832 00000100:00100000:1.0:1788940621.324906:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068504832 00000100:00100000:1.0:1788940621.324965:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788940621.324992:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:3303:x1875840068504832:12345-0@lo:400: 00000100:00100000:1.0:1788940621.325045:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:3303:x1875840068504832:12345-0@lo:400: Request processed in 55us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940621.325162:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788940621.325246:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068504960 00000100:00100000:0.0:1788940621.325251:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068504960 00000100:00100000:0.0:1788940621.325285:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068505088 00000100:00100000:0.0:1788940621.325288:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068505088 00000100:00100000:0.0:1788940621.325315:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068505216 00000100:00100000:0.0:1788940621.325318:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068505216 00000100:00100000:0.0:1788940621.325353:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788940621.325361:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068504960:12345-0@lo:400: 00000100:00100000:0.0:1788940621.325398:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068504960:12345-0@lo:400: Request processed in 38us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940621.325405:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788940621.325426:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788940621.325433:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068505088:12345-0@lo:400: 00000100:00100000:0.0:1788940621.325466:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068505088:12345-0@lo:400: Request processed in 35us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940621.325472:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788940621.325483:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788940621.325488:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068505216:12345-0@lo:400: 00000100:00100000:0.0:1788940621.325514:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068505216:12345-0@lo:400: Request processed in 26us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940621.325520:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788940621.325545:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788940621.325615:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a044000 x1875840068505216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940621.325629:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068505216:0@lo:400: 00010000:00080000:1.0:1788940621.325639:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a047b80 x1875840068505088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940621.325648:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068505088:0@lo:400: 00010000:00080000:1.0:1788940621.325678:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a047100 x1875840068504960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940621.325686:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068504960:0@lo:400: 00000100:00100000:1.0:1788940621.325694:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068504832:0@lo:400: 00010000:00010000:2.0:1788940621.385241:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940622.412141:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940623.436714:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788940623.880341:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788940623.880348:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f410f4f2000 from 30 10000000:01000000:0.0:1788940623.880354:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788940623.880401:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.880413:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.880424:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940623.880446:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068505344:0@lo:101: 00000100:00100000:0.0:1788940623.880514:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940623.880571:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4115c4e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788940623.880636:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068505344 00000100:00100000:1.0:1788940623.880644:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068505344 00000100:00100000:1.0:1788940623.880701:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788940623.880711:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:5830:x1875840068505344:12345-0@lo:101: 00010000:00010000:1.0:1788940623.880724:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940623.880737:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2bd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2bd1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.880762:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2bd1 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.880795:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2bd1 expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.880804:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142051c00, rc 0) 00000100:00100000:1.0:1788940623.880855:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068505344:12345-0@lo:101: Request processed in 146us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.880862:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788940623.880997:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068505344:0@lo:101: 00010000:00010000:0.0:1788940623.881012:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2bd8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.881027:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2bd8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940623.881073:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068505472:0@lo:501: 00000100:00100000:0.0:1788940623.881098:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940623.881118:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4115c4e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788940623.881161:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068505472 00000100:00100000:1.0:1788940623.881166:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068505472 00000100:00100000:0.0:1788940623.881267:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788940623.881276:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068505472:12345-0@lo:501: 00000100:00100000:0.0:1788940623.881548:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068505472:12345-0@lo:501: Request processed in 273us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940623.881555:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788940623.881626:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068505472:0@lo:501: 00000100:00100000:3.0:1788940623.881656:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111330700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068505600:0@lo:503: 00000100:00100000:3.0:1788940623.881696:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940623.881727:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a62b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940623.881774:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068505600 00000100:00100000:0.0:1788940623.881779:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068505600 00000100:00100000:0.0:1788940623.881818:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788940623.881825:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068505600:12345-0@lo:503: 00000100:00100000:0.0:1788940623.881971:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068505600:12345-0@lo:503: Request processed in 146us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940623.881978:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788940623.882049:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111330700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068505600:0@lo:503: 00000100:00100000:3.0:1788940623.882368:0:7945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111330700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7945:1875840068505728:0@lo:502: 00000100:00100000:3.0:1788940623.882400:0:7945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940623.882426:0:7945:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a62bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940623.882473:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068505728 00000100:00100000:0.0:1788940623.882479:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068505728 00000100:00100000:0.0:1788940623.882510:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788940623.882516:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:7945:x1875840068505728:12345-0@lo:502: 00000100:00100000:0.0:1788940623.882667:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:7945:x1875840068505728:12345-0@lo:502: Request processed in 151us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940623.882674:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788940623.882762:0:7945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111330700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7945:1875840068505728:0@lo:502: 00000100:00100000:3.0:1788940623.882814:0:7945:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111330700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7945:1875840068505856:0@lo:502: 00000100:00100000:3.0:1788940623.882846:0:7945:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940623.882871:0:7945:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a62bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940623.882941:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068505856 00000100:00100000:1.0:1788940623.882947:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068505856 00000100:00100000:1.0:1788940623.882966:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788940623.882972:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:7945:x1875840068505856:12345-0@lo:502: 00000100:00100000:1.0:1788940623.883100:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:7945:x1875840068505856:12345-0@lo:502: Request processed in 128us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.883107:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788940623.883210:0:7945:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111330700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7945:1875840068505856:0@lo:502: 00000040:00080000:3.0:1788940623.883232:0:7945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788940623.883413:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788940623.883432:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788940623.883442:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2bd8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.883453:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2bd8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940623.883461:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788940623.883463:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788940623.883466:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788940623.883488:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.883501:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.883510:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940623.883522:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a044e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068505984:0@lo:101: 00000100:00100000:1.0:1788940623.883546:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.883653:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4112bbbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940623.885020:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068505984 00000100:00100000:3.0:1788940623.885030:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068505984 00000100:00100000:3.0:1788940623.885072:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788940623.885082:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068505984:12345-0@lo:101: 00010000:00010000:3.0:1788940623.885096:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940623.885112:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2be6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2bdf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940623.885136:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2bdf expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940623.885148:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2bdf expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940623.885158:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36e00, rc 0) 00000100:00100000:3.0:1788940623.885227:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068505984:12345-0@lo:101: Request processed in 146us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940623.885234:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788940623.885282:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a044e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068505984:0@lo:101: 00010000:00010000:3.0:1788940623.885297:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2be6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940623.885307:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2be6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940623.885361:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111330700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068506112:0@lo:501: 00000100:00100000:3.0:1788940623.885393:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940623.885420:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a62b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940623.885432:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068506112 00000100:00100000:3.0:1788940623.885445:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068506112 00000100:00100000:3.0:1788940623.885467:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788940623.885473:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068506112:12345-0@lo:501: 00000100:00100000:3.0:1788940623.885792:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068506112:12345-0@lo:501: Request processed in 307us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940623.885800:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788940623.885833:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111330700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068506112:0@lo:501: 00000100:00100000:3.0:1788940623.885859:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111330700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068506240:0@lo:503: 00000100:00100000:3.0:1788940623.885892:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940623.885905:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a62b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940623.885917:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068506240 00000100:00100000:3.0:1788940623.885920:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068506240 00000100:00100000:3.0:1788940623.885941:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788940623.885947:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068506240:12345-0@lo:503: 00000100:00100000:3.0:1788940623.886166:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068506240:12345-0@lo:503: Request processed in 218us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940623.886173:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788940623.886228:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111330700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068506240:0@lo:503: 00000100:00100000:1.0:1788940623.889683:0:7946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7946:1875840068506368:0@lo:502: 00000100:00100000:1.0:1788940623.889769:0:7946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.889823:0:7946:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4112bbbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940623.889875:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068506368 00000100:00100000:3.0:1788940623.889887:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068506368 00000100:00100000:3.0:1788940623.889947:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788940623.889957:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:7946:x1875840068506368:12345-0@lo:502: 00000100:00100000:3.0:1788940623.890257:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:7946:x1875840068506368:12345-0@lo:502: Request processed in 301us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940623.890266:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788940623.890406:0:7946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7946:1875840068506368:0@lo:502: 00000020:01000000:2.0:1788940623.890437:0:7946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940623.890446:0:7946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940623.890449:0:7946:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788940623.890456:0:7946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788940623.890458:0:7946:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788940623.890475:0:7946:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7946:1875840068506496:0@lo:502: 00000100:00100000:2.0:1788940623.890511:0:7946:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940623.890543:0:7946:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4111892600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940623.890586:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068506496 00000100:00100000:3.0:1788940623.890597:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068506496 00000100:00100000:3.0:1788940623.890661:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788940623.890668:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:7946:x1875840068506496:12345-0@lo:502: 00000100:00100000:3.0:1788940623.890799:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:7946:x1875840068506496:12345-0@lo:502: Request processed in 131us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940623.890807:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788940623.890868:0:7946:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7946:1875840068506496:0@lo:502: 00000020:01000000:1.0:1788940623.890886:0:7946:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940623.890891:0:7946:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940623.890892:0:7946:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788940623.890896:0:7946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788940623.892887:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788940623.892920:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788940623.892938:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2be6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940623.892952:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2be6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940623.892961:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788940623.892964:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f411876b000 from 30 10000000:01000000:2.0:1788940623.892967:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788940623.893001:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940623.893009:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940623.893019:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940623.893038:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068506624:0@lo:101: 00000100:00100000:2.0:1788940623.893097:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940623.893172:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4111892480 going to sleep for 11 seconds 00000100:00100000:1.0:1788940623.894222:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068506624 00000100:00100000:1.0:1788940623.894234:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068506624 00000100:00100000:1.0:1788940623.894283:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788940623.894291:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068506624:12345-0@lo:101: 00010000:00010000:1.0:1788940623.894307:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940623.894321:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2bf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2bed expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.894347:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2bed expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.894373:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2bed expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.894381:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050e00, rc 0) 00000100:00100000:1.0:1788940623.894435:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068506624:12345-0@lo:101: Request processed in 145us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.894441:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788940623.894492:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068506624:0@lo:101: 00010000:00010000:1.0:1788940623.894508:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2bf4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.894517:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2bf4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940623.894574:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068506752:0@lo:501: 00000100:00100000:1.0:1788940623.894604:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.894629:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4112bbb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940623.894640:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068506752 00000100:00100000:1.0:1788940623.894644:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068506752 00000100:00100000:1.0:1788940623.894664:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788940623.894670:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068506752:12345-0@lo:501: 00000100:00100000:1.0:1788940623.894956:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068506752:12345-0@lo:501: Request processed in 284us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.894963:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788940623.894994:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068506752:0@lo:501: 00000100:00100000:1.0:1788940623.895022:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068506880:0@lo:503: 00000100:00100000:1.0:1788940623.895065:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.895079:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4112bbb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940623.895090:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068506880 00000100:00100000:1.0:1788940623.895093:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068506880 00000100:00100000:1.0:1788940623.895112:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788940623.895117:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068506880:12345-0@lo:503: 00000100:00100000:1.0:1788940623.895276:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068506880:12345-0@lo:503: Request processed in 157us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.895282:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788940623.895319:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068506880:0@lo:503: 00000100:00100000:1.0:1788940623.895464:0:7949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7949:1875840068507008:0@lo:502: 00000100:00100000:1.0:1788940623.895497:0:7949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.895517:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068507008 00000100:00100000:1.0:1788940623.895520:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068507008 00000100:00100000:1.0:1788940623.895539:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788940623.895545:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:7949:x1875840068507008:12345-0@lo:502: 00000100:00100000:1.0:1788940623.895699:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:7949:x1875840068507008:12345-0@lo:502: Request processed in 153us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.895706:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788940623.895731:0:7949:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4103511180 going to sleep for 11 seconds 00000100:00100000:1.0:1788940623.895743:0:7949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7949:1875840068507008:0@lo:502: 00000100:00100000:1.0:1788940623.895779:0:7949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7949:1875840068507136:0@lo:502: 00000100:00100000:1.0:1788940623.895821:0:7949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.895839:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068507136 00000100:00100000:1.0:1788940623.895842:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068507136 00000100:00100000:1.0:1788940623.895860:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788940623.895872:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:7949:x1875840068507136:12345-0@lo:502: 00000100:00100000:1.0:1788940623.895982:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:7949:x1875840068507136:12345-0@lo:502: Request processed in 110us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.895989:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788940623.896014:0:7949:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41073cc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940623.896024:0:7949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7949:1875840068507136:0@lo:502: 00000040:00080000:1.0:1788940623.896041:0:7949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788940623.896085:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788940623.896103:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788940623.896112:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2bf4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.896123:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2bf4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940623.896134:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788940623.896137:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f411876b000 from 5 10000000:01000000:1.0:1788940623.896140:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788940623.896160:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.896169:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.896177:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940623.896208:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068507264:0@lo:101: 00000100:00100000:1.0:1788940623.896232:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.896253:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41073cc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940623.896264:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068507264 00000100:00100000:1.0:1788940623.896267:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068507264 00000100:00100000:1.0:1788940623.896286:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788940623.896292:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068507264:12345-0@lo:101: 00010000:00010000:1.0:1788940623.896300:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940623.896312:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2c02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2bfb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.896329:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2bfb expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.896338:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2bfb expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.896346:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142051800, rc 0) 00000100:00100000:1.0:1788940623.896372:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068507264:12345-0@lo:101: Request processed in 81us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.896378:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788940623.896404:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068507264:0@lo:101: 00010000:00010000:1.0:1788940623.896415:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.896424:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940623.896463:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068507392:0@lo:256: 00000100:00100000:1.0:1788940623.896493:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.896505:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41073cc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940623.896520:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068507392 00000100:00100000:1.0:1788940623.896524:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068507392 00000100:00100000:1.0:1788940623.896543:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788940623.896548:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068507392:12345-0@lo:256: 20000000:01000000:1.0:1788940623.896559:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788940623.896577:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788940623.896580:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788940623.896649:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068507392:12345-0@lo:256: Request processed in 99us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.896656:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788940623.896682:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068507392:0@lo:256: 10000000:01000000:1.0:1788940623.896719:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788940623.896724:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.896730:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940623.896736:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788940623.896737:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788940623.896739:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788940623.896753:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.896759:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.896767:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940623.896802:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068507520:0@lo:101: 00000100:00100000:1.0:1788940623.896826:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.896838:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41073cc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940623.896849:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068507520 00000100:00100000:1.0:1788940623.896852:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068507520 00000100:00100000:1.0:1788940623.896872:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788940623.896877:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068507520:12345-0@lo:101: 00010000:00010000:1.0:1788940623.896884:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940623.896891:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4142050c00/0xa1d8aa9164aa2c10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2c09 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.896904:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142050c00/0xa1d8aa9164aa2c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2c09 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.896912:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4142050c00/0xa1d8aa9164aa2c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2c09 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.896919:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050c00, rc 0) 00000100:00100000:1.0:1788940623.896945:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068507520:12345-0@lo:101: Request processed in 67us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.896951:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788940623.896979:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068507520:0@lo:101: 00010000:00010000:1.0:1788940623.896988:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2c10 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940623.896995:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2c10 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940623.897041:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068507648:0@lo:501: 00000100:00100000:1.0:1788940623.897067:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.897080:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41073cc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940623.897090:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068507648 00000100:00100000:1.0:1788940623.897093:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068507648 00000100:00100000:1.0:1788940623.897111:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788940623.897116:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068507648:12345-0@lo:501: 00000100:00100000:1.0:1788940623.897380:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068507648:12345-0@lo:501: Request processed in 262us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.897389:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788940623.897421:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068507648:0@lo:501: 00000100:00100000:1.0:1788940623.897445:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068507776:0@lo:503: 00000100:00100000:1.0:1788940623.897481:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.897494:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41073cc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940623.897505:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068507776 00000100:00100000:1.0:1788940623.897508:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068507776 00000100:00100000:1.0:1788940623.897528:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788940623.897534:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068507776:12345-0@lo:503: 00000100:00100000:1.0:1788940623.897746:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068507776:12345-0@lo:503: Request processed in 210us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.897752:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788940623.906362:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068507776:0@lo:503: 00000100:00100000:1.0:1788940623.914215:0:7953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7953:1875840068507904:0@lo:502: 00000100:00100000:1.0:1788940623.914488:0:7953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.914771:0:7953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003b150c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940623.915807:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068507904 00000100:00100000:3.0:1788940623.915822:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068507904 00000100:00100000:3.0:1788940623.915889:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788940623.915900:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:7953:x1875840068507904:12345-0@lo:502: 00000100:00100000:3.0:1788940623.916298:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:7953:x1875840068507904:12345-0@lo:502: Request processed in 399us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940623.916306:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788940623.916406:0:7953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7953:1875840068507904:0@lo:502: 00000020:01000000:1.0:1788940623.916440:0:7953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940623.916449:0:7953:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788940623.916456:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940623.916459:0:7953:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788940623.916464:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788940623.916467:0:7953:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.117@tcp to nid 0x20000c0a8ca75 (192.168.202.117@tcp) 00000020:01000000:1.0:1788940623.916626:0:7953:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788940623.916629:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940623.916644:0:7953:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f413f41b380) 00000020:00000080:1.0:1788940623.916664:0:7953:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788940623.916667:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788940623.916756:0:7953:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788940623.916760:0:7953:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788940623.916766:0:7953:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa1d8aa9164aa2c1e 00010000:00080000:1.0:1788940623.916805:0:7953:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f4002193800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.117@tcp at head 00010000:00010000:1.0:1788940623.919029:0:7953:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788940623.921009:0:7953:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788940623.921026:0:7953:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788940623.927756:0:7953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940623.929180:0:7953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940623.929273:0:7953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788940623.929342:0:7953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788940623.931130:0:7957:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788940623.931137:0:7957:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788940623.934570:0:7953:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788940623.934594:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788940623.934642:0:7953:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788940623.934671:0:7953:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa1d8aa9164aa2c25 00000100:00080000:0.0:1788940623.934684:0:7953:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940623.934695:0:7953:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f4002193800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:0.0:1788940623.934727:0:7953:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f41129de680 x1875840068508032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940623.934759:0:7953:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788940623.934880:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068508288:0@lo:400: 00000100:00100000:0.0:1788940623.934952:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940623.934989:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940623.934995:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068508160:0@lo:400: 00000100:00100000:0.0:1788940623.935020:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.935022:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068508032:0@lo:8: 00000100:00100000:1.0:1788940623.935061:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940623.935083:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068508288 00000100:00100000:0.0:1788940623.935089:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068508288 00000100:00100000:1.0:1788940623.935116:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068508416:0@lo:400: 00000100:00100000:0.0:1788940623.935136:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068508160 00000100:00100000:0.0:1788940623.935140:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068508160 00000100:00100000:0.0:1788940623.935163:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940623.935172:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068508288:12345-0@lo:400: 00000100:00100000:0.0:1788940623.935250:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068508288:12345-0@lo:400: Request processed in 78us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940623.935259:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940623.935275:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940623.935281:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068508160:12345-0@lo:400: 00000100:00100000:0.0:1788940623.935309:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068508160:12345-0@lo:400: Request processed in 28us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940623.935329:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788940623.935349:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788940623.935385:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41129dd880 x1875840068508160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940623.935399:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068508160:0@lo:400: 00010000:00080000:0.0:1788940623.935409:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41129df100 x1875840068508288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940623.935417:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068508288:0@lo:400: 00000100:00100000:1.0:1788940623.935450:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940623.935472:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940623.935478:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068508544:0@lo:400: 00000020:01000000:0.0:1788940623.935493:0:7953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940623.935499:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940623.935501:0:7953:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788940623.935504:0:7953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:1.0:1788940623.935506:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788940623.935509:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940623.935511:0:7953:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788940623.935514:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788940623.935516:0:7953:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788940623.935541:0:7953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7953:1875840068508672:0@lo:502: 00000100:00100000:0.0:1788940623.935588:0:7953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940623.935613:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068508672 00000100:00100000:0.0:1788940623.935617:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068508672 00000100:00100000:0.0:1788940623.935647:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788940623.935653:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:7953:x1875840068508672:12345-0@lo:502: 00000100:00100000:0.0:1788940623.935913:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:7953:x1875840068508672:12345-0@lo:502: Request processed in 259us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940623.935920:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788940623.935957:0:7953:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f7ced80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940623.935970:0:7953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:7953:1875840068508672:0@lo:502: 00000020:01000000:0.0:1788940623.935996:0:7953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940623.936000:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940623.936002:0:7953:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788940623.936005:0:7953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788940623.936052:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788940623.936067:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788940623.936076:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2c10 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.936087:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2c10 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940623.936097:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788940623.936100:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f4118288000 from 1 10000000:01000000:0.0:1788940623.936102:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788940623.936126:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.936134:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.936144:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940623.936157:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068508800:0@lo:101: 00000100:00100000:0.0:1788940623.936205:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940623.936220:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940623.936233:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068508800 00000100:00100000:0.0:1788940623.936236:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068508800 00000100:00100000:0.0:1788940623.936261:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788940623.936274:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068508800:12345-0@lo:101: 00010000:00010000:0.0:1788940623.936284:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940623.936296:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa2c33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2c2c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.936320:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa2c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2c2c expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.936330:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa2c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2c2c expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.936339:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100031000, rc 0) 00000100:00100000:0.0:1788940623.936369:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068508800:12345-0@lo:101: Request processed in 95us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940623.936375:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788940623.936403:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068508800:0@lo:101: 00010000:00010000:0.0:1788940623.936416:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2c33 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940623.936422:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068508032 00010000:00010000:0.0:1788940623.936425:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2c33 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940623.936427:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068508032 00000100:00100000:1.0:1788940623.936446:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068508416 00000100:00100000:1.0:1788940623.936449:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068508416 00000100:00100000:0.0:1788940623.936460:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068508928:0@lo:501: 00000100:00100000:1.0:1788940623.936475:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940623.936482:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068508416:12345-0@lo:400: 00000100:00100000:0.0:1788940623.936483:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940623.936495:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940623.936506:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068508928 00000100:00100000:0.0:1788940623.936509:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068508928 00000100:00100000:1.0:1788940623.936518:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068508416:12345-0@lo:400: Request processed in 37us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.936525:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788940623.936527:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788940623.936531:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068508928:12345-0@lo:501: 00000100:00100000:1.0:1788940623.936535:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940623.936755:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068508928:12345-0@lo:501: Request processed in 222us (269us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940623.936762:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788940623.936804:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068508928:0@lo:501: 10000000:01000000:0.0:1788940623.936822:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788940623.936828:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2c33 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940623.936835:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2c33 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940623.936871:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3300:x1875840068508032:12345-0@lo:8: 00010000:00080000:1.0:1788940623.936894:0:6674:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:1.0:1788940623.936932:0:6674:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa1d8aa9164aa2c3a 00002000:00100000:1.0:1788940623.936948:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f4002194000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788940623.936953:0:6674:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788940623.936957:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788940623.937071:0:6674:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788940623.939269:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068508544 00000100:00100000:2.0:1788940623.939285:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068508544 00000100:00100000:2.0:1788940623.939346:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940623.939356:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068508544:12345-0@lo:400: 00000100:00100000:2.0:1788940623.939442:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068508544:12345-0@lo:400: Request processed in 87us (3934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940623.939450:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788940623.940284:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940623.940291:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788940623.940606:0:6674:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788940623.940642:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8f4002196000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940623.940718:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1875840068508032:12345-0@lo:8: Request processed in 4176us (5654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940623.940728:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788940623.940778:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41129dc000 x1875840068508544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788940623.940836:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41129de680 x1875840068508032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940623.940847:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788940623.940856:0:3300:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788940623.940865:0:3300:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788940623.940871:0:3300:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788940623.940874:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f4002193800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788940623.941370:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788940623.941382:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068508032:0@lo:8: 00000004:00080000:3.0:1788940623.941444:0:7957:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788940623.941627:0:7957:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 265245438512ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788940623.942036:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068508544:0@lo:400: 00010000:00080000:1.0:1788940623.942072:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41129ded80 x1875840068508416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940623.942083:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068508416:0@lo:400: 00000004:00080000:2.0:1788940624.003135:0:7958:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788940624.003169:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875840068509184:0@lo:7: 00000100:00100000:2.0:1788940624.003268:0:7958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940624.003321:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41073040c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788940624.003351:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788940624.003377:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068509056:0@lo:13: 00000100:00100000:2.0:1788940624.003403:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940624.003441:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068509184 00000100:00100000:2.0:1788940624.003448:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068509184 00000100:00100000:2.0:1788940624.003500:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940624.003509:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7958:x1875840068509184:12345-0@lo:7: 00000100:00100000:0.0:1788940624.007409:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068509056 00000100:00100000:0.0:1788940624.007425:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068509056 00000100:00100000:0.0:1788940624.007484:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788940624.007494:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875840068509056:12345-0@lo:13: 00002000:00000024:0.0:1788940624.007529:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788940624.007620:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875840068509056:12345-0@lo:13: Request processed in 128us (4216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940624.007627:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788940624.010233:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788940624.010308:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134690700 x1875840068509056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940624.010340:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068509056:0@lo:13: 00002000:00080000:0.0:1788940624.015088:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788940624.015102:0:6671:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788940624.015231:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7958:x1875840068509184:12345-0@lo:7: Request processed in 11718us (11958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940624.015241:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788940624.015393:0:7958:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134690380 x1875840068509184/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788940640 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940624.015409:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875840068509184:0@lo:7: 00000004:00080000:2.0:1788940624.015424:0:7958:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788940624.015464:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875840068509312:0@lo:5: 00000100:00100000:2.0:1788940624.015497:0:7958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940624.015548:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41073040c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940624.015593:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068509312 00000100:00100000:0.0:1788940624.015600:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068509312 00000100:00100000:0.0:1788940624.015648:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788940624.015658:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7958:x1875840068509312:12345-0@lo:5: 00002000:00080000:0.0:1788940624.015685:0:6674:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788940624.015690:0:6674:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788940624.016250:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7958:x1875840068509312:12345-0@lo:5: Request processed in 592us (751us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788940624.016258:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788940624.016340:0:7958:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134690380 x1875840068509312/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940640 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940624.016353:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875840068509312:0@lo:5: 00000004:00080000:2.0:1788940624.016370:0:7958:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788940624.016396:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875840068509440:0@lo:700: 00000100:00100000:2.0:1788940624.016455:0:7958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940624.016479:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41073040c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940624.017508:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068509440 00000100:00100000:0.0:1788940624.017517:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068509440 00000100:00100000:0.0:1788940624.017555:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940624.017563:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7958:x1875840068509440:12345-0@lo:700: 00000100:00100000:0.0:1788940624.017602:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129de680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6680:1875840068509568:0@lo:700: 00000100:00100000:0.0:1788940624.017646:0:6680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940624.017662:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f7ce480 going to sleep for 11 seconds 00000100:00100000:1.0:1788940624.019867:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068509568 00000100:00100000:1.0:1788940624.019883:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068509568 00000100:00100000:1.0:1788940624.019938:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940624.019948:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6680:x1875840068509568:12345-0@lo:700: 40000000:02000000:1.0:1788940624.083258:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788940624.091555:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6680:x1875840068509568:12345-0@lo:700: Request processed in 71600us (73900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940624.091570:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788940624.092280:0:6680:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41129de680 x1875840068509568/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788940640 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940624.092297:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129de680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6680:1875840068509568:0@lo:700: 40000000:02000000:2.0:1788940624.092313:0:6680:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:02000400:2.0:1788940624.138548:0:7979:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg217-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:3.0:1788940624.224337:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788940624.224361:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788940624.224543:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7958:x1875840068509440:12345-0@lo:700: Request processed in 206975us (208081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940624.224557:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788940624.224694:0:7958:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134693b80 x1875840068509440/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788940640 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940624.224706:0:7958:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788940624.224723:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875840068509440:0@lo:700: 00000004:02000040:1.0:1788940624.258673:0:7958:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788940624.264047:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a046300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875840068509696:0@lo:5: 00000100:00100000:1.0:1788940624.264146:0:7958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940624.264331:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003b15840 going to sleep for 11 seconds 00000100:00100000:0.0:1788940624.264501:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068509696 00000100:00100000:0.0:1788940624.264512:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068509696 00000100:00100000:0.0:1788940624.264572:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940624.264581:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7958:x1875840068509696:12345-0@lo:5: 00002000:00080000:0.0:1788940624.276010:0:6671:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788940624.276042:0:6671:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788940624.287827:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7958:x1875840068509696:12345-0@lo:5: Request processed in 23235us (23669us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788940624.287848:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788940624.288442:0:7958:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a046300 x1875840068509696/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788940640 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940624.288461:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a046300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7958:1875840068509696:0@lo:5: 00000004:00080000:3.0:1788940624.288478:0:7958:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788940624.456455:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940625.481375:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940625.937590:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940625.937641:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068509824:0@lo:13: 00000100:00100000:0.0:1788940625.937743:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940625.937857:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068509824 00000100:00100000:0.0:1788940625.937868:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068509824 00000100:00100000:0.0:1788940625.937943:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788940625.937955:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068509824:12345-0@lo:13: 00002000:00000024:0.0:1788940625.938004:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940625.938059:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068509824:12345-0@lo:13: Request processed in 106us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940625.938066:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788940625.938091:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940625.938128:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41129dd880 x1875840068509824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940641 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940625.938150:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068509824:0@lo:13: 00010000:00010000:1.0:1788940626.504740:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940627.528358:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940628.552769:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940629.007244:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068509952:0@lo:400: 00000100:00100000:1.0:1788940629.007317:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940629.007458:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068509952 00000100:00100000:0.0:1788940629.007466:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068509952 00000100:00100000:0.0:1788940629.007510:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788940629.007519:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068509952:12345-0@lo:400: 00000100:00100000:2.0:1788940629.008411:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068510080:0@lo:400: 00000100:00100000:2.0:1788940629.008451:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940629.012388:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940629.012411:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068510464:0@lo:400: 00000100:00100000:2.0:1788940629.012476:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940629.012558:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a66e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068510592:0@lo:400: 00000100:00100000:2.0:1788940629.012598:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940629.012632:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068510592 00000100:00100000:2.0:1788940629.012640:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068510592 00000100:00100000:2.0:1788940629.012693:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940629.012702:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875840068510592:12345-0@lo:400: 00000100:00100000:2.0:1788940629.012772:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875840068510592:12345-0@lo:400: Request processed in 71us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940629.012787:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788940629.012831:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a66e680 x1875840068510592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940629.012846:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a66e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068510592:0@lo:400: 00000100:00100000:3.0:1788940629.013013:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068510208:0@lo:400: 00000100:00100000:3.0:1788940629.013050:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940629.013079:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940629.013084:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068510336:0@lo:400: 00000100:00100000:3.0:1788940629.013105:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940629.014789:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068510080 00000100:00100000:2.0:1788940629.014800:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068510080 00000100:00100000:2.0:1788940629.014856:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068510464 00000100:00100000:2.0:1788940629.014860:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068510464 00000100:00100000:2.0:1788940629.014876:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068510208 00000100:00100000:2.0:1788940629.014878:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068510208 00000100:00100000:2.0:1788940629.014895:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788940629.014903:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068510080:12345-0@lo:400: 00000100:00100000:2.0:1788940629.014970:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068510080:12345-0@lo:400: Request processed in 68us (6518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940629.014977:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788940629.014993:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788940629.015000:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068510464:12345-0@lo:400: 00000100:00100000:2.0:1788940629.015028:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068510464:12345-0@lo:400: Request processed in 29us (2552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940629.015033:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788940629.015044:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788940629.015049:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068510208:12345-0@lo:400: 00000100:00100000:2.0:1788940629.015079:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068510208:12345-0@lo:400: Request processed in 29us (2028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940629.015084:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788940629.015120:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134693b80 x1875840068510464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940629.015147:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068510464:0@lo:400: 00010000:00080000:2.0:1788940629.015163:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4111330380 x1875840068510080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940629.015171:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068510080:0@lo:400: 00010000:00080000:3.0:1788940629.015272:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134690e00 x1875840068510208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940629.015282:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068510208:0@lo:400: 00000100:00080000:2.0:1788940629.016290:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940629.016296:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940629.016761:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068509952:12345-0@lo:400: Request processed in 9239us (9439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940629.016772:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788940629.017294:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068509952:0@lo:400: 00000100:00100000:1.0:1788940629.017329:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068510336 00000100:00100000:1.0:1788940629.017347:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068510336 00000100:00100000:1.0:1788940629.017406:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788940629.017414:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068510336:12345-0@lo:400: 00000100:00100000:1.0:1788940629.017476:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068510336:12345-0@lo:400: Request processed in 63us (4369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940629.017482:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788940629.017550:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940629.018351:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134690000 x1875840068510336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940629.018364:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068510336:0@lo:400: 00000100:00100000:2.0:1788940629.520699:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a66e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068510720:0@lo:13: 00000100:00100000:2.0:1788940629.520776:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940629.520848:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068510720 00000100:00100000:2.0:1788940629.520855:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068510720 00000100:00100000:2.0:1788940629.520897:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940629.520905:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875840068510720:12345-0@lo:13: 00002000:00000024:2.0:1788940629.520940:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940629.520983:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875840068510720:12345-0@lo:13: Request processed in 78us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940629.520990:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788940629.521053:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a66e680 x1875840068510720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940629.521070:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a66e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068510720:0@lo:13: 00010000:00010000:2.0:1788940629.578069:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788940629.644487:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788940630.602374:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940630.891232:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940630.892748:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035979392 00000100:00100000:2.0:1788940630.892762:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035979392 00000100:00100000:2.0:1788940630.892806:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 115 00000100:00100000:2.0:1788940630.892814:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2357:x1875840035979392:12345-192.168.202.17@tcp:250: 00010000:00080000:2.0:1788940630.892852:0:5826:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from cd220973-afce-4e0b-b310-f94af7a18e79@192.168.202.17@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:2.0:1788940630.892879:0:5826:0:(genops.c:1384:class_connect()) connect: client cd220973-afce-4e0b-b310-f94af7a18e79, cookie 0xa1d8aa9164aa2c41 00000100:00080000:2.0:1788940630.893030:0:5826:0:(import.c:65:import_set_state_nolock()) ffff8f413a723000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940630.894822:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+5:2357:x1875840035979392:12345-192.168.202.17@tcp:250: Request processed in 1271us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940630.894835:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 115 00000100:00100000:3.0:1788940630.915750:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940630.916478:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035979520 00000100:00100000:0.0:1788940630.916488:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035979520 00000100:00100000:0.0:1788940630.916540:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 116 00000100:00100000:0.0:1788940630.916550:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+5:5590:x1875840035979520:12345-192.168.202.17@tcp:101: 00010000:00010000:0.0:1788940630.916567:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940630.916588:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4100030800/0xa1d8aa9164aa2c48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2262d2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940630.916624:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4100030800/0xa1d8aa9164aa2c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d2 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940630.916639:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4100030800/0xa1d8aa9164aa2c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d2 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940630.916648:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100030800, rc 0) 00000100:00100000:0.0:1788940630.916698:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+6:5590:x1875840035979520:12345-192.168.202.17@tcp:101: Request processed in 149us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940630.916705:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 116 00000100:00100000:2.0:1788940630.922501:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940630.922544:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035979648 00000100:00100000:0.0:1788940630.922557:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035979648 00000100:00100000:0.0:1788940630.922615:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 117 00000100:00100000:0.0:1788940630.922625:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+6:5590:x1875840035979648:12345-192.168.202.17@tcp:501: 00000100:00100000:0.0:1788940630.923088:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+6:5590:x1875840035979648:12345-192.168.202.17@tcp:501: Request processed in 463us (596us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940630.923098:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 117 00000100:00100000:0.0:1788940630.925488:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940630.925577:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035979776 00000100:00100000:1.0:1788940630.925587:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035979776 00000100:00100000:1.0:1788940630.925642:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 118 00000100:00100000:1.0:1788940630.925651:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+6:5590:x1875840035979776:12345-192.168.202.17@tcp:101: 00010000:00010000:1.0:1788940630.925668:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940630.925686:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2c4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2262d9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940630.925726:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d9 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940630.925739:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d9 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940630.925748:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142051e00, rc 0) 00000100:00100000:1.0:1788940630.925800:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+7:5590:x1875840035979776:12345-192.168.202.17@tcp:101: Request processed in 150us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940630.925808:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 118 00000100:00100000:0.0:1788940630.929260:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940630.929294:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035979904 00000100:00100000:0.0:1788940630.929304:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035979904 00000100:00100000:0.0:1788940630.929362:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 119 00000100:00100000:0.0:1788940630.929373:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+7:5590:x1875840035979904:12345-192.168.202.17@tcp:501: 00000100:00100000:0.0:1788940630.929639:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+8:5590:x1875840035979904:12345-192.168.202.17@tcp:501: Request processed in 266us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940630.929646:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 119 00000100:00100000:0.0:1788940630.940691:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940630.940831:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035980032 00000100:00100000:2.0:1788940630.940851:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035980032 00000100:00100000:2.0:1788940630.940902:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 120 00000100:00100000:2.0:1788940630.940912:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+8:5590:x1875840035980032:12345-192.168.202.17@tcp:503: 00000100:00100000:2.0:1788940630.941737:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+8:5590:x1875840035980032:12345-192.168.202.17@tcp:503: Request processed in 822us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940630.941747:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 120 00000100:00100000:2.0:1788940630.953110:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940630.953384:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035980160 00000100:00100000:1.0:1788940630.953394:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035980160 00000100:00100000:1.0:1788940630.953445:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 121 00000100:00100000:1.0:1788940630.953454:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+8:5609:x1875840035980160:12345-192.168.202.17@tcp:502: 00000100:00100000:0.0:1788940630.958739:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+8:5609:x1875840035980160:12345-192.168.202.17@tcp:502: Request processed in 5274us (5629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940630.958753:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 121 00000100:00100000:3.0:1788940631.005227:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940631.005471:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035980288 00000100:00100000:1.0:1788940631.005482:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035980288 00000100:00100000:1.0:1788940631.005538:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 122 00000100:00100000:1.0:1788940631.005547:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+8:5609:x1875840035980288:12345-192.168.202.17@tcp:502: 00000100:00100000:1.0:1788940631.005878:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+8:5609:x1875840035980288:12345-192.168.202.17@tcp:502: Request processed in 330us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940631.005887:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 122 00000100:00100000:1.0:1788940631.016294:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940631.016332:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035980416 00000100:00100000:1.0:1788940631.016343:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035980416 00000100:00100000:1.0:1788940631.016395:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 123 00000100:00100000:1.0:1788940631.016407:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+8:5590:x1875840035980416:12345-192.168.202.17@tcp:101: 00010000:00010000:1.0:1788940631.016517:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940631.016538:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4142051200/0xa1d8aa9164aa2c56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226303 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940631.016568:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142051200/0xa1d8aa9164aa2c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226303 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940631.016581:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4142051200/0xa1d8aa9164aa2c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226303 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940631.016710:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142051200, rc 0) 00000100:00100000:1.0:1788940631.016780:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+9:5590:x1875840035980416:12345-192.168.202.17@tcp:101: Request processed in 373us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940631.016788:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 123 00000100:00100000:2.0:1788940631.030425:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940631.030497:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035980544 00000100:00100000:3.0:1788940631.030508:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035980544 00000100:00100000:3.0:1788940631.030558:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 124 00000100:00100000:3.0:1788940631.030567:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+9:5590:x1875840035980544:12345-192.168.202.17@tcp:256: 20000000:01000000:3.0:1788940631.030599:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788940631.030615:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788940631.030619:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788940631.030623:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788940631.030625:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788940631.034794:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+9:5590:x1875840035980544:12345-192.168.202.17@tcp:256: Request processed in 4217us (4367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940631.034810:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 124 00000100:00100000:1.0:1788940631.041947:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940631.042180:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035980672 00000100:00100000:0.0:1788940631.042221:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035980672 00000100:00100000:0.0:1788940631.042274:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 125 00000100:00100000:0.0:1788940631.042283:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+9:5590:x1875840035980672:12345-192.168.202.17@tcp:101: 00010000:00010000:0.0:1788940631.042300:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940631.042316:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4100031800/0xa1d8aa9164aa2c5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22630a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940631.042341:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4100031800/0xa1d8aa9164aa2c5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22630a expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940631.042352:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4100031800/0xa1d8aa9164aa2c5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22630a expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940631.042362:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100031800, rc 0) 00000100:00100000:0.0:1788940631.042458:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:5590:x1875840035980672:12345-192.168.202.17@tcp:101: Request processed in 175us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940631.042466:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 125 00000100:00100000:1.0:1788940631.045561:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940631.045639:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035980800 00000100:00100000:3.0:1788940631.045658:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035980800 00000100:00100000:3.0:1788940631.045706:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 126 00000100:00100000:3.0:1788940631.045725:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:5590:x1875840035980800:12345-192.168.202.17@tcp:501: 00000100:00100000:3.0:1788940631.046050:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:5590:x1875840035980800:12345-192.168.202.17@tcp:501: Request processed in 334us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940631.046064:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 126 00000100:00100000:3.0:1788940631.048687:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940631.048980:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940631.049008:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068510848:0@lo:13: 00000100:00100000:0.0:1788940631.049052:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940631.049167:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068510848 00000100:00100000:3.0:1788940631.049175:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068510848 00000100:00100000:3.0:1788940631.049236:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940631.049244:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068510848:12345-0@lo:13: 00002000:00000024:3.0:1788940631.049276:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940631.049313:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068510848:12345-0@lo:13: Request processed in 70us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940631.049319:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788940631.049505:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4111332300 x1875840068510848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940631.049523:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068510848:0@lo:13: 00000100:00080000:2.0:1788940631.049630:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940631.049780:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035980928 00000100:00100000:1.0:1788940631.049785:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035980928 00000100:00100000:1.0:1788940631.049897:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 127 00000100:00100000:1.0:1788940631.049905:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+10:5590:x1875840035980928:12345-192.168.202.17@tcp:503: 00000100:00100000:1.0:1788940631.050398:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+10:5590:x1875840035980928:12345-192.168.202.17@tcp:503: Request processed in 492us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940631.050405:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 127 00000100:00100000:3.0:1788940631.060012:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940631.060536:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035981056 00000100:00100000:2.0:1788940631.060546:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035981056 00000100:00100000:2.0:1788940631.060613:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 128 00000100:00100000:2.0:1788940631.060621:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4107279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:5614:x1875840035981056:12345-192.168.202.17@tcp:502: 00000100:00100000:2.0:1788940631.062157:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4107279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:5614:x1875840035981056:12345-192.168.202.17@tcp:502: Request processed in 1527us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940631.062168:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 128 00000100:00100000:2.0:1788940631.067093:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940631.067218:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035981184 00000100:00100000:3.0:1788940631.067234:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035981184 00000100:00100000:3.0:1788940631.067291:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 129 00000100:00100000:3.0:1788940631.067300:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410727b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:5614:x1875840035981184:12345-192.168.202.17@tcp:502: 00000100:00100000:3.0:1788940631.067550:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410727b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:5614:x1875840035981184:12345-192.168.202.17@tcp:502: Request processed in 250us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940631.067558:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 129 00000100:00100000:3.0:1788940631.074918:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940631.075487:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035981312 00000100:00100000:0.0:1788940631.075498:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035981312 00000100:00100000:0.0:1788940631.075544:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 4 00000100:00100000:0.0:1788940631.075552:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1875840035981312:12345-192.168.202.17@tcp:38: 00010000:00080000:0.0:1788940631.075579:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:0.0:1788940631.075624:0:5834:0:(genops.c:1384:class_connect()) connect: client 9fbe6afa-4201-4af1-bbe2-c715064eeb39, cookie 0xa1d8aa9164aa2c64 00000004:00100000:0.0:1788940631.075653:0:5834:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788940631.075658:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788940631.125663:0:5834:0:(import.c:65:import_set_state_nolock()) ffff8f413a6cf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940631.125751:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2357:x1875840035981312:12345-192.168.202.17@tcp:38: Request processed in 50197us (50843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940631.125763:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 4 00010000:00010000:0.0:1788940631.632326:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940632.146001:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940632.146045:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940632.146321:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035981440 00000100:00100000:2.0:1788940632.146345:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035981440 00000100:00100000:2.0:1788940632.146411:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035981568 00000100:00100000:2.0:1788940632.146414:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035981568 00000100:00100000:2.0:1788940632.146433:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:2.0:1788940632.146443:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:0:x1875840035981440:12345-192.168.202.17@tcp:41: 00000004:00000024:2.0:1788940632.146487:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788940632.146550:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:0:x1875840035981440:12345-192.168.202.17@tcp:41: Request processed in 108us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940632.146557:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:2.0:1788940632.146575:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00100000:2.0:1788940632.146580:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:5590:x1875840035981568:12345-192.168.202.17@tcp:41: 00000004:00000024:2.0:1788940632.146590:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788940632.146606:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:5590:x1875840035981568:12345-192.168.202.17@tcp:41: Request processed in 26us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940632.146612:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00080000:3.0:1788940632.147220:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940632.156284:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940632.157060:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035981696 00000100:00100000:2.0:1788940632.157073:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035981696 00000100:00100000:2.0:1788940632.157134:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:2.0:1788940632.157143:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:5590:x1875840035981696:12345-192.168.202.17@tcp:40: 00000100:00100000:2.0:1788940632.157259:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:5590:x1875840035981696:12345-192.168.202.17@tcp:40: Request processed in 117us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940632.157267:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:3.0:1788940632.165444:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940632.165483:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940632.165514:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940632.165616:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035982080 00000100:00100000:0.0:1788940632.165628:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035982080 00000100:00100000:0.0:1788940632.165680:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:0.0:1788940632.165690:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:5590:x1875840035982080:12345-192.168.202.17@tcp:33: 00000100:00100000:2.0:1788940632.166809:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035981824 00000100:00100000:2.0:1788940632.166819:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035981824 00000100:00100000:2.0:1788940632.166856:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035981952 00000100:00100000:2.0:1788940632.166860:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035981952 00000100:00100000:2.0:1788940632.166881:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 8 00000100:00100000:2.0:1788940632.166908:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875840035981824:12345-192.168.202.17@tcp:8: 00010000:00080000:2.0:1788940632.166936:0:6671:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:2.0:1788940632.166979:0:6671:0:(genops.c:1384:class_connect()) connect: client 9fbe6afa-4201-4af1-bbe2-c715064eeb39, cookie 0xa1d8aa9164aa2c6b 00002000:00100000:2.0:1788940632.166992:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9fbe6afa-4201-4af1-bbe2-c715064eeb39/ffff8f413a726000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788940632.167013:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788940632.167692:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788940632.167741:0:6671:0:(import.c:65:import_set_state_nolock()) ffff8f413a727800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940632.167822:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2357:x1875840035981824:12345-192.168.202.17@tcp:8: Request processed in 925us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940632.167830:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 8 00000100:00100000:2.0:1788940632.167852:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00100000:2.0:1788940632.167857:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875840035981952:12345-192.168.202.17@tcp:8: 00010000:00080000:2.0:1788940632.167875:0:6671:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:2.0:1788940632.167895:0:6671:0:(genops.c:1384:class_connect()) connect: client 9fbe6afa-4201-4af1-bbe2-c715064eeb39, cookie 0xa1d8aa9164aa2c72 00002000:00100000:2.0:1788940632.167902:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9fbe6afa-4201-4af1-bbe2-c715064eeb39/ffff8f413a722000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788940632.167917:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788940632.168144:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788940632.168159:0:6671:0:(import.c:65:import_set_state_nolock()) ffff8f413a726800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940632.168335:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2357:x1875840035981952:12345-192.168.202.17@tcp:8: Request processed in 475us (2819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940632.168343:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00100000:3.0:1788940632.169252:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940632.169486:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035982208 00000100:00100000:2.0:1788940632.169494:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035982208 00000100:00100000:2.0:1788940632.169538:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 130 00000100:00100000:2.0:1788940632.169545:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840035982208:12345-192.168.202.17@tcp:400: 00000100:00100000:2.0:1788940632.170167:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840035982208:12345-192.168.202.17@tcp:400: Request processed in 618us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940632.170177:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 130 00000004:00080000:2.0:1788940632.215156:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 49357us 00000004:00200000:2.0:1788940632.241876:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788940632.241995:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:5590:x1875840035982080:12345-192.168.202.17@tcp:33: Request processed in 76301us (76556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940632.242011:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:3.0:1788940632.463555:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940632.463662:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035982336 00000100:00100000:0.0:1788940632.463674:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035982336 00000100:00100000:0.0:1788940632.463755:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 8 00000100:00100000:0.0:1788940632.463768:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:5631:x1875840035982336:12345-192.168.202.17@tcp:101: 00010000:00010000:0.0:1788940632.463789:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940632.463865:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030c00/0xa1d8aa9164aa2c79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226334 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940632.463956:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2c80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940632.463971:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940632.463986:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940632.464025:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788940632.464029:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940632.464339:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940632.464373:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030c00/0xa1d8aa9164aa2c79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226334 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940632.464392:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2c80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226334 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940632.465132:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f600) 00010000:00010000:0.0:1788940632.465146:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940632.465151:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235c00, rc 0) 00000100:00100000:0.0:1788940632.465310:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:5631:x1875840035982336:12345-192.168.202.17@tcp:101: Request processed in 1541us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940632.465320:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 8 00010000:00010000:1.0:1788940632.648420:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788940633.205569:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9fbe6afa-4201-4af1-bbe2-c715064eeb39 00010000:00010000:2.0:1788940633.672375:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940634.122901:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940634.122982:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940634.123017:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068511104:0@lo:400: 00000100:00100000:1.0:1788940634.123102:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940634.123383:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068511104 00000100:00100000:3.0:1788940634.123392:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068511104 00000100:00100000:3.0:1788940634.123449:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940634.123459:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068511104:12345-0@lo:400: 00000100:00100000:3.0:1788940634.123515:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068511104:12345-0@lo:400: Request processed in 58us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940634.123535:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788940634.123629:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068511104:0@lo:400: 00000100:00100000:2.0:1788940634.127445:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068510976:0@lo:400: 00000100:00100000:2.0:1788940634.127546:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940634.127735:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068510976 00000100:00100000:1.0:1788940634.127751:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068510976 00000100:00100000:1.0:1788940634.127806:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788940634.127815:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068510976:12345-0@lo:400: 00000100:00100000:1.0:1788940634.127878:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068510976:12345-0@lo:400: Request processed in 63us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940634.127885:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788940634.128353:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068510976:0@lo:400: 00000100:00100000:3.0:1788940634.133838:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068511488:0@lo:400: 00000100:00100000:3.0:1788940634.133916:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940634.134132:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068511232:0@lo:400: 00000100:00100000:2.0:1788940634.134164:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940634.134252:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068511488 00000100:00100000:2.0:1788940634.134261:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068511488 00000100:00100000:2.0:1788940634.134319:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068511232 00000100:00100000:2.0:1788940634.134322:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068511232 00000100:00100000:2.0:1788940634.134348:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940634.134356:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068511488:12345-0@lo:400: 00000100:00100000:1.0:1788940634.134436:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068511360:0@lo:400: 00000100:00100000:1.0:1788940634.134491:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940634.134526:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068511360 00000100:00100000:1.0:1788940634.134530:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068511360 00000100:00100000:1.0:1788940634.134559:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940634.134566:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068511360:12345-0@lo:400: 00000100:00100000:1.0:1788940634.134607:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068511360:12345-0@lo:400: Request processed in 42us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940634.134614:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940634.134642:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940634.134649:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068511232:12345-0@lo:400: 00000100:00100000:1.0:1788940634.134680:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068511232:12345-0@lo:400: Request processed in 32us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940634.134698:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940634.134738:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068511232:0@lo:400: 00010000:00080000:1.0:1788940634.134770:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41129df480 x1875840068511360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940634.134780:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068511360:0@lo:400: 00000100:00100000:1.0:1788940634.134802:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068511616:0@lo:400: 00000100:00100000:1.0:1788940634.134825:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940634.134851:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068511616 00000100:00100000:1.0:1788940634.134855:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068511616 00000100:00100000:1.0:1788940634.134878:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940634.134884:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068511616:12345-0@lo:400: 00000100:00100000:1.0:1788940634.134913:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068511616:12345-0@lo:400: Request processed in 30us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940634.134919:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788940634.134943:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41129ded80 x1875840068511616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940634.134951:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788940634.134961:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068511616:0@lo:400: 00000100:00080000:1.0:1788940634.135008:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940634.135012:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940634.135015:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940634.154375:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068511488:12345-0@lo:400: Request processed in 20009us (20448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940634.154391:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940634.161764:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068511488:0@lo:400: 00000100:00100000:1.0:1788940634.632883:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a66c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068511744:0@lo:13: 00000100:00100000:1.0:1788940634.632965:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940634.634415:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068511744 00000100:00100000:2.0:1788940634.634429:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068511744 00000100:00100000:2.0:1788940634.634500:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940634.634510:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068511744:12345-0@lo:13: 00002000:00000024:2.0:1788940634.634544:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940634.634619:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068511744:12345-0@lo:13: Request processed in 110us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940634.634627:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788940634.635269:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a66c380 x1875840068511744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940634.635292:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a66c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068511744:0@lo:13: 00000100:00100000:2.0:1788940634.645590:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940634.645715:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035982464 00000100:00100000:1.0:1788940634.645731:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035982464 00000100:00100000:1.0:1788940634.645832:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00100000:1.0:1788940634.645846:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:5683:x1875840035982464:12345-192.168.202.17@tcp:41: 00000004:00000024:1.0:1788940634.645911:0:7198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788940634.646050:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:5683:x1875840035982464:12345-192.168.202.17@tcp:41: Request processed in 207us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940634.646059:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00080000:3.0:1788940634.646958:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940634.661169:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940634.662352:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035982592 00000100:00100000:2.0:1788940634.662371:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035982592 00000100:00100000:2.0:1788940634.662487:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:2.0:1788940634.662500:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:5683:x1875840035982592:12345-192.168.202.17@tcp:13: 00002000:00000024:2.0:1788940634.662554:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940634.662648:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:5683:x1875840035982592:12345-192.168.202.17@tcp:13: Request processed in 150us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940634.662656:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00080000:3.0:1788940634.664086:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940634.671488:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940634.671956:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035982720 00000100:00100000:2.0:1788940634.671980:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035982720 00000100:00100000:2.0:1788940634.672132:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00100000:2.0:1788940634.672146:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:5683:x1875840035982720:12345-192.168.202.17@tcp:13: 00002000:00000024:2.0:1788940634.672180:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940634.672333:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:5683:x1875840035982720:12345-192.168.202.17@tcp:13: Request processed in 191us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940634.672342:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00080000:3.0:1788940634.673243:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788940634.697428:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940635.729406:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940636.169878:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068511872:0@lo:13: 00000100:00100000:3.0:1788940636.169971:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940636.172168:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068511872 00000100:00100000:1.0:1788940636.172184:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068511872 00000100:00100000:1.0:1788940636.172268:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788940636.172280:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068511872:12345-0@lo:13: 00002000:00000024:1.0:1788940636.172320:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940636.173004:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068511872:12345-0@lo:13: Request processed in 722us (3028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940636.173014:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788940636.173063:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940636.173099:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4111332680 x1875840068511872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940636.173121:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068511872:0@lo:13: 00000001:00100000:0.0:1788940636.315720:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9fbe6afa-4201-4af1-bbe2-c715064eeb39 00010000:00010000:0.0:1788940636.757292:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788940636.875842:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000100:00100000:1.0:1788940637.369801:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940637.369848:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940637.369889:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940637.369923:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940637.369959:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035983104 00000100:00100000:1.0:1788940637.369969:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035983104 00000100:00100000:1.0:1788940637.370050:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035983232 00000100:00100000:1.0:1788940637.370054:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035983232 00000100:00100000:1.0:1788940637.370073:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:1.0:1788940637.370085:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840035983104:12345-192.168.202.17@tcp:400: 00000100:00100000:1.0:1788940637.370166:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840035983104:12345-192.168.202.17@tcp:400: Request processed in 83us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940637.370174:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:1.0:1788940637.370223:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:1.0:1788940637.370230:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840035983232:12345-192.168.202.17@tcp:400: 00000100:00100000:1.0:1788940637.370255:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840035983232:12345-192.168.202.17@tcp:400: Request processed in 26us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940637.370262:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00080000:1.0:1788940637.370278:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940637.370282:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940637.370472:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035982848 00000100:00100000:2.0:1788940637.370478:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035982848 00000100:00100000:2.0:1788940637.370527:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 132 00000100:00100000:2.0:1788940637.370535:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:2358:x1875840035982848:12345-192.168.202.17@tcp:400: 00000100:00100000:2.0:1788940637.370586:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:2358:x1875840035982848:12345-192.168.202.17@tcp:400: Request processed in 52us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940637.370593:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 132 00000100:00100000:0.0:1788940637.370867:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035982976 00000100:00100000:0.0:1788940637.370873:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035982976 00000100:00100000:0.0:1788940637.370922:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 28 00000100:00100000:0.0:1788940637.370931:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840035982976:12345-192.168.202.17@tcp:400: 00000100:00100000:0.0:1788940637.370963:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840035982976:12345-192.168.202.17@tcp:400: Request processed in 33us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940637.370969:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 28 00000100:00080000:2.0:1788940637.371083:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788940637.768328:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940638.807356:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788940638.812821:0:8288:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788940639.241601:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068512128:0@lo:400: 00000100:00100000:2.0:1788940639.241708:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940639.241782:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068512640:0@lo:400: 00000100:00100000:2.0:1788940639.241806:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940639.241838:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788940639.241843:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068512000:0@lo:400: 00000100:00100000:2.0:1788940639.241872:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940639.241887:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068512512:0@lo:400: 00000100:00100000:2.0:1788940639.241904:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940639.241962:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068512128 00000100:00100000:2.0:1788940639.241971:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068512128 00000100:00100000:3.0:1788940639.242214:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068512512 00000100:00100000:3.0:1788940639.242219:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068512512 00000100:00100000:1.0:1788940639.242340:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068512384:0@lo:400: 00000100:00100000:1.0:1788940639.242379:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940639.242432:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940639.242438:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068512256:0@lo:400: 00000100:00100000:1.0:1788940639.242462:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940639.242493:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068512640 00000100:00100000:1.0:1788940639.242497:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068512640 00000100:00100000:1.0:1788940639.242556:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068512384 00000100:00100000:1.0:1788940639.242560:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068512384 00000100:00100000:1.0:1788940639.242581:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940639.242590:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068512640:12345-0@lo:400: 00000100:00100000:1.0:1788940639.242667:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068512640:12345-0@lo:400: Request processed in 78us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940639.242675:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940639.242693:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788940639.242699:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068512384:12345-0@lo:400: 00000100:00100000:1.0:1788940639.242729:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068512384:12345-0@lo:400: Request processed in 31us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940639.242734:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788940639.242755:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068512256 00000100:00100000:1.0:1788940639.242757:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068512256 00000100:00100000:1.0:1788940639.242787:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788940639.242794:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068512256:12345-0@lo:400: 00000100:00100000:1.0:1788940639.242823:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068512256:12345-0@lo:400: Request processed in 30us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940639.242829:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788940639.242845:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940639.242850:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940639.242852:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940639.242890:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068512256:0@lo:400: 00010000:00080000:1.0:1788940639.242915:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413f871500 x1875840068512384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940639.242927:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068512384:0@lo:400: 00010000:00080000:1.0:1788940639.242974:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413f870000 x1875840068512640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940639.242984:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068512640:0@lo:400: 00000100:00100000:3.0:1788940639.243097:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940639.243104:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068512512:12345-0@lo:400: 00000100:00100000:3.0:1788940639.243138:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068512512:12345-0@lo:400: Request processed in 35us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940639.243144:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788940639.243164:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068512000 00000100:00100000:3.0:1788940639.243168:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068512000 00000100:00100000:3.0:1788940639.246844:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788940639.246882:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068512000:12345-0@lo:400: 00000100:00100000:3.0:1788940639.247025:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068512000:12345-0@lo:400: Request processed in 164us (5150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940639.247034:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1788940639.247113:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940639.249432:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068512000:0@lo:400: 00000100:00100000:0.0:1788940639.249464:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068512512:0@lo:400: 00000100:00100000:0.0:1788940639.249583:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788940639.249598:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068512128:12345-0@lo:400: 00000100:00100000:0.0:1788940639.249731:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068512128:12345-0@lo:400: Request processed in 138us (8022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940639.249739:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788940639.250399:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068512128:0@lo:400: 00000100:00100000:2.0:1788940639.753509:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a66f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068512768:0@lo:13: 00000100:00100000:2.0:1788940639.753605:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940639.753834:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068512768 00000100:00100000:1.0:1788940639.753845:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068512768 00000100:00100000:1.0:1788940639.753908:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940639.753919:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068512768:12345-0@lo:13: 00002000:00000024:1.0:1788940639.753968:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940639.754037:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068512768:12345-0@lo:13: Request processed in 120us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940639.754057:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788940639.756695:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a66f800 x1875840068512768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940639.756734:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a66f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068512768:0@lo:13: 00010000:00010000:1.0:1788940639.821019:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940640.850979:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940641.292653:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940641.292700:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068512896:0@lo:13: 00000100:00100000:0.0:1788940641.292805:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940641.297102:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068512896 00000100:00100000:1.0:1788940641.297128:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068512896 00000100:00100000:1.0:1788940641.297616:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940641.297640:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068512896:12345-0@lo:13: 00000100:00080000:0.0:1788940641.299011:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788940641.299361:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940641.302073:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068512896:12345-0@lo:13: Request processed in 4417us (9250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940641.302092:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788940641.303312:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41129dc000 x1875840068512896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940641.303346:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068512896:0@lo:13: 00010000:00010000:1.0:1788940641.867706:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940642.478180:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940642.478273:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940642.478325:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940642.478357:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940642.478396:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035983360 00000100:00100000:2.0:1788940642.478408:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035983360 00000100:00100000:2.0:1788940642.478495:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 134 00000100:00100000:2.0:1788940642.478508:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+10:2361:x1875840035983360:12345-192.168.202.17@tcp:400: 00000100:00100000:3.0:1788940642.478791:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035983488 00000100:00100000:3.0:1788940642.478798:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035983488 00000100:00100000:3.0:1788940642.478852:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 32 00000100:00100000:3.0:1788940642.478860:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2361:x1875840035983488:12345-192.168.202.17@tcp:400: 00000100:00100000:3.0:1788940642.478909:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2361:x1875840035983488:12345-192.168.202.17@tcp:400: Request processed in 49us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940642.478917:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 32 00000100:00100000:0.0:1788940642.479245:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035983744 00000100:00100000:0.0:1788940642.479252:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035983744 00000100:00100000:0.0:1788940642.479294:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035983616 00000100:00100000:0.0:1788940642.479297:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035983616 00000100:00100000:0.0:1788940642.479318:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 14 00000100:00100000:0.0:1788940642.479326:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840035983744:12345-192.168.202.17@tcp:400: 00000100:00100000:0.0:1788940642.479359:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840035983744:12345-192.168.202.17@tcp:400: Request processed in 34us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940642.479366:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 14 00000100:00100000:0.0:1788940642.479381:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 15 00000100:00100000:0.0:1788940642.479387:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840035983616:12345-192.168.202.17@tcp:400: 00000100:00100000:0.0:1788940642.479412:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840035983616:12345-192.168.202.17@tcp:400: Request processed in 26us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940642.479433:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 15 00000100:00080000:0.0:1788940642.479452:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940642.479456:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940642.479460:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940642.480739:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+10:2361:x1875840035983360:12345-192.168.202.17@tcp:400: Request processed in 98us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940642.480765:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 134 00010000:00010000:1.0:1788940642.892846:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940643.935825:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940644.365114:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068513024:0@lo:400: 00000100:00100000:2.0:1788940644.365410:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940644.366682:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068513024 00000100:00100000:2.0:1788940644.366694:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068513024 00000100:00100000:2.0:1788940644.366759:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788940644.366769:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068513024:12345-0@lo:400: 00000100:00100000:2.0:1788940644.366846:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068513024:12345-0@lo:400: Request processed in 79us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.366854:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788940644.366905:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068513024:0@lo:400: 00000100:00100000:1.0:1788940644.378441:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068513280:0@lo:400: 00000100:00100000:1.0:1788940644.378512:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940644.378549:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940644.378556:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068513408:0@lo:400: 00000100:00100000:1.0:1788940644.378584:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940644.378754:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068513536:0@lo:400: 00000100:00100000:1.0:1788940644.378783:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940644.378807:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788940644.378814:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068513152:0@lo:400: 00000100:00100000:1.0:1788940644.378844:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940644.378865:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068513664:0@lo:400: 00000100:00100000:1.0:1788940644.378891:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940644.378924:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068513280 00000100:00100000:1.0:1788940644.378932:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068513280 00000100:00100000:1.0:1788940644.379099:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068513536 00000100:00100000:1.0:1788940644.379103:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068513536 00000100:00100000:1.0:1788940644.379123:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068513152 00000100:00100000:1.0:1788940644.379126:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068513152 00000100:00100000:1.0:1788940644.379141:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940644.379150:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068513280:12345-0@lo:400: 00000100:00100000:2.0:1788940644.379248:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068513408 00000100:00100000:2.0:1788940644.379253:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068513408 00000100:00100000:2.0:1788940644.379286:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068513664 00000100:00100000:2.0:1788940644.379289:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068513664 00000100:00100000:2.0:1788940644.379306:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940644.379314:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068513408:12345-0@lo:400: 00000100:00080000:0.0:1788940644.384687:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940644.384697:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940644.384703:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940644.384725:0:6671:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788940644.384737:0:6671:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788940644.384749:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068513408:12345-0@lo:400: Request processed in 5430us (6159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.384770:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940644.384804:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940644.384816:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068513664:12345-0@lo:400: 00000100:00100000:2.0:1788940644.384876:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068513664:12345-0@lo:400: Request processed in 64us (5985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.384882:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940644.384906:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788940644.384914:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068513536:12345-0@lo:400: 00000100:00100000:2.0:1788940644.384949:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068513536:12345-0@lo:400: Request processed in 36us (6166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.384955:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788940644.384969:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788940644.384977:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068513152:12345-0@lo:400: 00000100:00100000:2.0:1788940644.385006:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068513152:12345-0@lo:400: Request processed in 31us (6165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940644.385136:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068513280:12345-0@lo:400: Request processed in 5986us (6623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940644.385144:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788940644.385198:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f411129a300 x1875840068513408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940644.385214:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068513408:0@lo:400: 00000100:00100000:1.0:1788940644.385228:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068513280:0@lo:400: 00000100:00100000:2.0:1788940644.386119:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788940644.386172:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068513152:0@lo:400: 00010000:00080000:2.0:1788940644.386210:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f411129b800 x1875840068513664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940660 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940644.386221:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068513664:0@lo:400: 00000100:00100000:2.0:1788940644.386233:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068513536:0@lo:400: 00000020:00000080:0.0:1788940644.480908:0:8437:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed61a8b10 20000000:00000080:0.0:1788940644.480928:0:8437:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f4111255800 uarg=0000000000000000 20000000:01000000:0.0:1788940644.480967:0:8437:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788940644.480970:0:8437:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788940644.480979:0:8437:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788940644.480984:0:8437:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788940644.480989:0:8437:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788940644.481005:0:8437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788940644.481007:0:8437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788940644.481701:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788940644.481706:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788940644.483801:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788940644.484979:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788940644.485055:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788940644.485094:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1788940644.485110:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788940644.485114:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788940644.486812:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788940644.491774:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788940644.491854:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788940644.491890:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1788940644.491907:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788940644.491909:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788940644.493074:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788940644.493902:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788940644.493964:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788940644.494000:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788940644.494012:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788940644.494015:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788940644.495457:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788940644.500877:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788940644.500934:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788940644.502699:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:1.0:1788940644.502736:0:8437:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788940644.502758:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.502776:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4100031200/0xa1d8aa9164aa2b84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b7d expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.502783:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4100031400/0xa1d8aa9164aa2bae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ba7 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.502789:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2bd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2bd1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.502795:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2be6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2bdf expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.502800:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2bf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2bed expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.502806:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4142050c00/0xa1d8aa9164aa2c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2c09 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.502813:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa2c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2c2c expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.502821:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4100030800/0xa1d8aa9164aa2c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d2 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.502847:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d9 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.502853:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.502894:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d9 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.502908:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2c4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d9 expref: 9 pid: 5827 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940644.502921:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068513792:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940644.503688:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4100030800/0xa1d8aa9164aa2c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d2 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.503701:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f4100030800/0xa1d8aa9164aa2c48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d2 expref: 9 pid: 5828 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940644.503711:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068513920:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940644.503742:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa2c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2c2c expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.503749:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa2c33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2c2c expref: 18 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940644.503757:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068514048:0@lo:104: 00000100:00100000:1.0:1788940644.503794:0:8437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940644.504239:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4142050c00/0xa1d8aa9164aa2c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2c09 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.504249:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4142050c00/0xa1d8aa9164aa2c10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2c09 expref: 18 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940644.504258:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068514176:0@lo:104: 00000100:00100000:1.0:1788940644.504294:0:8437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940644.505871:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2bed expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.505886:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2bf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bed expref: 18 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940644.505899:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068514304:0@lo:104: 00010000:00010000:1.0:1788940644.506048:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2bdf expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.506057:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bdf expref: 18 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940644.506066:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068514432:0@lo:104: 00010000:00010000:1.0:1788940644.506095:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2bd1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.506104:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2bd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bd1 expref: 18 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940644.506112:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068514560:0@lo:104: 00010000:00010000:1.0:1788940644.506181:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4100031400/0xa1d8aa9164aa2bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2ba7 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.506710:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4100031400/0xa1d8aa9164aa2bae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ba7 expref: 18 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940644.506720:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068514688:0@lo:104: 00010000:00010000:1.0:1788940644.506758:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4100031200/0xa1d8aa9164aa2b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2b7d expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.506766:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4100031200/0xa1d8aa9164aa2b84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b7d expref: 18 pid: 5826 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940644.506773:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068514816:0@lo:104: 00000100:00100000:1.0:1788940644.506791:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344300 going to sleep for 11 seconds 00000100:00100000:2.0:1788940644.506965:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068514048 00000100:00100000:2.0:1788940644.506973:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068514048 00000100:00100000:2.0:1788940644.507678:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068514176 00000100:00100000:2.0:1788940644.507685:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068514176 00000100:00100000:2.0:1788940644.507704:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940644.507711:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+4:8437:x1875840068514048:12345-0@lo:104: 00010000:00010000:2.0:1788940644.507725:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2c33 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.507845:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788940644.507852:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+4:8437:x1875840068514048:12345-0@lo:104: Request processed in 141us (4057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.507869:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940644.507887:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788940644.507893:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:8437:x1875840068514176:12345-0@lo:104: 00010000:00010000:2.0:1788940644.507901:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2c10 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.507963:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788940644.507968:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:8437:x1875840068514176:12345-0@lo:104: Request processed in 76us (3674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.507974:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788940644.508015:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940644.508030:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940644.508040:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940644.508049:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940644.508059:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940644.508068:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068514304 00000100:00100000:2.0:1788940644.508071:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068514304 00000100:00100000:2.0:1788940644.508084:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068514432 00000100:00100000:2.0:1788940644.508086:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068514432 00000100:00100000:2.0:1788940644.508094:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068514560 00000100:00100000:2.0:1788940644.508106:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068514560 00000100:00100000:2.0:1788940644.508117:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068514688 00000100:00100000:2.0:1788940644.508119:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068514688 00000100:00100000:2.0:1788940644.508128:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068514816 00000100:00100000:2.0:1788940644.508130:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068514816 00000100:00100000:2.0:1788940644.508161:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940644.508167:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+7:8437:x1875840068514304:12345-0@lo:104: 00010000:00010000:2.0:1788940644.508175:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2bf4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.508228:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788940644.508233:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+7:8437:x1875840068514304:12345-0@lo:104: Request processed in 66us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.508238:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940644.508249:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940644.508255:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+6:8437:x1875840068514432:12345-0@lo:104: 00010000:00010000:2.0:1788940644.508262:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2be6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.508292:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788940644.508297:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+6:8437:x1875840068514432:12345-0@lo:104: Request processed in 43us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.508302:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940644.508312:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940644.508317:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+5:8437:x1875840068514560:12345-0@lo:104: 00010000:00010000:2.0:1788940644.508324:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2bd8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.508351:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788940644.508361:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+5:8437:x1875840068514560:12345-0@lo:104: Request processed in 43us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.508366:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788940644.508549:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788940644.508557:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2c33 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508565:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030200 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:3.0:1788940644.508569:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2c33 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508578:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2c33 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940644.508585:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2c33 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940644.508639:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940644.508675:0:7621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2c33 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508682:0:7621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940644.508780:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2c33 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508788:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa2c2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2c33 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508800:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788940644.508802:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2c10 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508807:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050600 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:3.0:1788940644.508810:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2c10 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508816:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2c10 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940644.508821:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2c10 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940644.508827:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940644.508841:0:7621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2c10 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508847:0:7621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940644.508858:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2c10 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508865:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4142050600/0xa1d8aa9164aa2c09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2c10 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508873:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788940644.508877:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2bf4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508881:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7000 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:3.0:1788940644.508884:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2bf4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508890:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2bf4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940644.508895:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2bf4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940644.508900:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940644.508913:0:7621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2bf4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508919:0:7621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940644.508932:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2bf4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508938:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7000/0xa1d8aa9164aa2bed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2bf4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508947:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940644.508956:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2be6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508961:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050a00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:3.0:1788940644.508964:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2be6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.508970:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2be6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940644.508975:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2be6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940644.508980:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940644.508996:0:7621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2be6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.509001:0:7621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940644.509006:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2be6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.509012:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4142050a00/0xa1d8aa9164aa2bdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2be6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.509020:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940644.509023:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2bd8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.509028:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030600 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:3.0:1788940644.509030:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2bd8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.509045:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2bd8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940644.509052:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2bd8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940644.509057:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940644.509071:0:7621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2bd8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.509076:0:7621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940644.509081:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2bd8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.509087:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa2bd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2bd8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.509094:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940644.509096:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940644.509098:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940644.509124:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068514944:0@lo:103: 00000100:00100000:3.0:1788940644.509162:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940644.509320:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788940644.509331:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+4:8437:x1875840068514688:12345-0@lo:104: 00010000:00010000:2.0:1788940644.509339:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2bae expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.509600:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788940644.509607:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+4:8437:x1875840068514688:12345-0@lo:104: Request processed in 278us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.509614:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788940644.509716:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068514048:0@lo:104: 00000100:00100000:3.0:1788940644.509866:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068515456:0@lo:103: 00000100:00100000:3.0:1788940644.509895:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940644.509921:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940644.509927:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068515072:0@lo:103: 00000100:00100000:3.0:1788940644.509945:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940644.509970:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068515200:0@lo:103: 00000100:00100000:3.0:1788940644.510003:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940644.510020:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940644.510025:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068515328:0@lo:103: 00000100:00100000:3.0:1788940644.510044:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940644.510066:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068514944 00000100:00100000:3.0:1788940644.510072:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068514944 00010000:00010000:3.0:1788940644.510097:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa2c33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2c2c expref: 19 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940644.510114:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068515456 00000100:00100000:3.0:1788940644.510117:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068515456 00000100:00100000:1.0:1788940644.510315:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940644.510345:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00010000:00010000:3.0:1788940644.510568:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2bd8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bd1 expref: 20 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940644.510585:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068515072 00000100:00100000:3.0:1788940644.510599:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068515072 00010000:00010000:3.0:1788940644.510613:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4142050c00/0xa1d8aa9164aa2c10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2c09 expref: 21 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940644.510623:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068515200 00000100:00100000:3.0:1788940644.510626:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068515200 00010000:00010000:3.0:1788940644.510634:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2bf4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bed expref: 22 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940644.510643:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068515328 00000100:00100000:3.0:1788940644.510646:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068515328 00010000:00010000:3.0:1788940644.510655:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2be6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bdf expref: 23 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940644.510666:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035983872 00000100:00100000:3.0:1788940644.510668:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035983872 00010000:00010000:3.0:1788940644.510679:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2c4f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d9 expref: 10 pid: 5827 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940644.510696:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035984000 00000100:00100000:3.0:1788940644.510698:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035984000 00010000:00010000:3.0:1788940644.510708:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4100030800/0xa1d8aa9164aa2c48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d2 expref: 11 pid: 5828 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940644.510719:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788940644.510726:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+23:3303:x1875840068514944:12345-0@lo:103: 00010000:00010000:3.0:1788940644.510742:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940644.510747:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa2c33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2c2c expref: 23 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.510757:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa2c33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2c2c expref: 23 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.510771:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa2c33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2c2c expref: 23 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.510785:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940644.510831:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+22:3303:x1875840068514944:12345-0@lo:103: Request processed in 105us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.510838:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788940644.510859:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940644.510865:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+21:3303:x1875840068515456:12345-0@lo:103: 00010000:00010000:3.0:1788940644.510873:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940644.510877:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2bd8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bd1 expref: 21 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.510884:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2bd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bd1 expref: 21 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.510899:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940644.510922:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+21:3303:x1875840068515456:12345-0@lo:103: Request processed in 57us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.510929:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940644.510940:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940644.510945:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+20:3303:x1875840068515072:12345-0@lo:103: 00010000:00010000:3.0:1788940644.510952:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940644.510956:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4142050c00/0xa1d8aa9164aa2c10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2c09 expref: 20 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.510963:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4142050c00/0xa1d8aa9164aa2c10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2c09 expref: 20 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.510971:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940644.510990:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+20:3303:x1875840068515072:12345-0@lo:103: Request processed in 45us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.510997:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940644.511009:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940644.511014:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068515200:12345-0@lo:103: 00010000:00010000:3.0:1788940644.511021:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940644.511025:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2bf4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bed expref: 19 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.511033:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2bf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bed expref: 19 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.511041:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940644.511078:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068515200:12345-0@lo:103: Request processed in 64us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.511083:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940644.511095:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788940644.511101:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f873480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:3301:x1875840068515328:12345-0@lo:103: 00010000:00010000:3.0:1788940644.511108:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940644.511113:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2be6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bdf expref: 18 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.511120:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2be6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bdf expref: 18 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940644.511313:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068515072:0@lo:103: 00000100:00100000:1.0:1788940644.511322:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068514944:0@lo:103: 00000100:00100000:1.0:1788940644.511329:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068515456:0@lo:103: 00010000:00010000:3.0:1788940644.511452:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940644.511479:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f873480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:3301:x1875840068515328:12345-0@lo:103: Request processed in 379us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.511485:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788940644.511499:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 17 00000100:00100000:3.0:1788940644.511574:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd220973-afce-4e0b-b310-f94af7a18e79+11:2358:x1875840035983872:12345-192.168.202.17@tcp:103: 00010000:00010000:3.0:1788940644.511584:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940644.511596:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2c4f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d9 expref: 11 pid: 5827 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.511607:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2c4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d9 expref: 11 pid: 5827 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.511617:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940644.511698:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd220973-afce-4e0b-b310-f94af7a18e79+11:2358:x1875840035983872:12345-192.168.202.17@tcp:103: Request processed in 192us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.511705:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 17 00000100:00100000:3.0:1788940644.511727:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:3.0:1788940644.511734:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41080e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840035984000:12345-192.168.202.17@tcp:103: 00010000:00010000:3.0:1788940644.511742:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940644.511747:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4100030800/0xa1d8aa9164aa2c48 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d2 expref: 10 pid: 5828 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.511756:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4100030800/0xa1d8aa9164aa2c48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d2 expref: 10 pid: 5828 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.511766:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940644.511785:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41080e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840035984000:12345-192.168.202.17@tcp:103: Request processed in 51us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.511791:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 18 00010000:00010000:3.0:1788940644.511829:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940644.511837:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2bae expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.511844:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6200 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:3.0:1788940644.511848:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2bae expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.511856:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2bae expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940644.511863:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2bae expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940644.511870:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940644.511901:0:7621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2bae expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.511914:0:7621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940644.511931:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2bae expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.511937:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6200/0xa1d8aa9164aa2ba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2bae expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.511950:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940644.511952:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940644.511954:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940644.511985:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068515328:0@lo:103: 00000100:00100000:3.0:1788940644.511994:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068515200:0@lo:103: 00000100:00100000:3.0:1788940644.512025:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068515584:0@lo:103: 00000100:00100000:3.0:1788940644.512056:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940644.512093:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068515584 00000100:00100000:3.0:1788940644.512099:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068515584 00010000:00010000:3.0:1788940644.512115:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4100031400/0xa1d8aa9164aa2bae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ba7 expref: 18 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940644.512278:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788940644.512287:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:3304:x1875840068515584:12345-0@lo:103: 00010000:00010000:3.0:1788940644.512295:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940644.512299:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4100031400/0xa1d8aa9164aa2bae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ba7 expref: 18 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.512306:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4100031400/0xa1d8aa9164aa2bae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ba7 expref: 18 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940644.512325:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940644.512352:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:3304:x1875840068515584:12345-0@lo:103: Request processed in 67us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940644.512358:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788940644.512483:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940644.512493:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:8437:x1875840068514816:12345-0@lo:104: 00010000:00010000:2.0:1788940644.512513:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2b84 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940644.512582:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068515584:0@lo:103: 00010000:00010000:0.0:1788940644.512758:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142050c00/0xa1d8aa9164aa2c10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2c09 expref: 17 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.512770:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068514176:0@lo:104: 00010000:00010000:0.0:1788940644.512780:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2bf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bed expref: 16 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.512796:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068514304:0@lo:104: 00010000:00010000:0.0:1788940644.512808:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4113b36e00/0xa1d8aa9164aa2be6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bdf expref: 15 pid: 5827 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.512816:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068514432:0@lo:104: 00010000:00010000:0.0:1788940644.512826:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2bd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2bd1 expref: 14 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.512834:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068514560:0@lo:104: 00010000:00010000:0.0:1788940644.512842:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4100031400/0xa1d8aa9164aa2bae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ba7 expref: 13 pid: 5828 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.512851:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068514688:0@lo:104: 00000100:00100000:0.0:1788940644.512858:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068514816:0@lo:104: 00010000:00010000:0.0:1788940644.512870:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2c4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d9 expref: 9 pid: 5827 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.512878:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068513792:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940644.512888:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4100030800/0xa1d8aa9164aa2c48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2262d2 expref: 8 pid: 5828 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940644.512896:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875840068513920:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940644.512941:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.513684:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788940644.513706:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:8437:x1875840068514816:12345-0@lo:104: Request processed in 1214us (5643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.513714:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788940644.513768:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940644.513784:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2b84 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.513793:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6000 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:0.0:1788940644.513797:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2b84 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.513805:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2b84 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940644.513811:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2b84 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940644.513817:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940644.513864:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b84 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.513871:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940644.513898:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b84 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.513905:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6000/0xa1d8aa9164aa2b7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2b84 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.513919:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940644.513920:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940644.513922:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940644.513929:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940644.513934:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940644.514058:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068515712:0@lo:103: 00000100:00100000:1.0:1788940644.514107:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940644.514313:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068515712 00000100:00100000:2.0:1788940644.514320:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068515712 00010000:00010000:2.0:1788940644.514343:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4100031200/0xa1d8aa9164aa2b84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b7d expref: 13 pid: 5826 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940644.514370:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788940644.514390:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:3301:x1875840068515712:12345-0@lo:103: 00010000:00010000:2.0:1788940644.514409:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940644.514414:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4100031200/0xa1d8aa9164aa2b84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b7d expref: 13 pid: 5826 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.514424:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4100031200/0xa1d8aa9164aa2b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b7d expref: 13 pid: 5826 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.514435:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4100031200/0xa1d8aa9164aa2b84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b7d expref: 13 pid: 5826 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.514447:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.514456:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.514468:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.514475:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.514481:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.514487:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.514492:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051400 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940644.514496:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.514638:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.514653:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940644.514662:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940644.514693:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:3301:x1875840068515712:12345-0@lo:103: Request processed in 317us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.514700:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788940644.514799:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068515712:0@lo:103: 00000100:00100000:0.0:1788940644.514872:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00010000:00010000:0.0:1788940644.514915:0:8437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.514929:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940644.514935:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2c87 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940644.515303:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940644.874342:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940644.874370:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068515840:0@lo:13: 00000100:00100000:1.0:1788940644.874443:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940644.875274:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068515840 00000100:00100000:2.0:1788940644.875284:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068515840 00000100:00100000:2.0:1788940644.875340:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788940644.875349:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068515840:12345-0@lo:13: 00002000:00000024:2.0:1788940644.875384:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940644.875448:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068515840:12345-0@lo:13: Request processed in 101us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940644.875455:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788940644.875548:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a66d880 x1875840068515840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940644.875570:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068515840:0@lo:13: 00010000:00010000:0.0:1788940644.936425:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788940645.640397:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788940645.640405:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f413f3b7800 from 39 10000000:01000000:2.0:1788940645.640411:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788940645.640461:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940645.640473:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940645.640483:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940645.640537:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a66d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068515968:0@lo:101: 00000100:00100000:2.0:1788940645.640623:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940645.640705:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41109d8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940645.640846:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068515968 00000100:00100000:1.0:1788940645.640856:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068515968 00000100:00100000:1.0:1788940645.640912:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788940645.640922:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+12:5830:x1875840068515968:12345-0@lo:101: 00010000:00010000:1.0:1788940645.640935:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940645.640950:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4142050000/0xa1d8aa9164aa2c95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2c8e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.640974:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142050000/0xa1d8aa9164aa2c95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2c8e expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.640984:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4142050000/0xa1d8aa9164aa2c95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2c8e expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.640993:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050000, rc 0) 00000100:00100000:1.0:1788940645.641035:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:5830:x1875840068515968:12345-0@lo:101: Request processed in 114us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940645.641040:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788940645.641347:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a66d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068515968:0@lo:101: 00010000:00010000:3.0:1788940645.641363:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2c95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.641372:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2c95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940645.641424:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f871180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068516096:0@lo:501: 00000100:00100000:3.0:1788940645.641455:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.641486:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003b15a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940645.641642:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068516096 00000100:00100000:1.0:1788940645.641648:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068516096 00000100:00100000:1.0:1788940645.641681:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788940645.641688:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:5830:x1875840068516096:12345-0@lo:501: 00000100:00100000:1.0:1788940645.641960:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:5830:x1875840068516096:12345-0@lo:501: Request processed in 272us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940645.641967:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788940645.642313:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f871180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068516096:0@lo:501: 00000100:00100000:0.0:1788940645.642365:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068516224:0@lo:503: 00000100:00100000:0.0:1788940645.642408:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940645.642428:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f412baef780 going to sleep for 11 seconds 00000100:00100000:1.0:1788940645.642547:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068516224 00000100:00100000:1.0:1788940645.642552:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068516224 00000100:00100000:1.0:1788940645.642571:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788940645.642576:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:5830:x1875840068516224:12345-0@lo:503: 00000100:00100000:1.0:1788940645.642865:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:5830:x1875840068516224:12345-0@lo:503: Request processed in 287us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940645.642872:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788940645.652207:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068516224:0@lo:503: 00000100:00100000:0.0:1788940645.655354:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8453:1875840068516352:0@lo:502: 00000100:00100000:0.0:1788940645.655446:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940645.655496:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f412baef240 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.655568:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068516352 00000100:00100000:3.0:1788940645.655575:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068516352 00000100:00100000:3.0:1788940645.655636:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788940645.655645:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:8453:x1875840068516352:12345-0@lo:502: 00000100:00100000:3.0:1788940645.655926:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:8453:x1875840068516352:12345-0@lo:502: Request processed in 281us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.655934:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788940645.656985:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8453:1875840068516352:0@lo:502: 00000100:00100000:0.0:1788940645.658308:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8453:1875840068516480:0@lo:502: 00000100:00100000:0.0:1788940645.658376:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940645.658413:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f412baef240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940645.658592:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068516480 00000100:00100000:1.0:1788940645.658601:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068516480 00000100:00100000:1.0:1788940645.658654:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788940645.658663:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:8453:x1875840068516480:12345-0@lo:502: 00000100:00100000:1.0:1788940645.658899:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:8453:x1875840068516480:12345-0@lo:502: Request processed in 236us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940645.658906:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788940645.660274:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8453:1875840068516480:0@lo:502: 00000040:00080000:0.0:1788940645.660314:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788940645.660500:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788940645.660534:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788940645.660544:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2c95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.660556:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2c95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940645.660565:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788940645.660567:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788940645.660570:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788940645.660611:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.660619:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.660628:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940645.660644:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f871880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068516608:0@lo:101: 00000100:00100000:3.0:1788940645.660704:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.660737:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003b153c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940645.660842:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068516608 00000100:00100000:1.0:1788940645.660849:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068516608 00000100:00100000:1.0:1788940645.660894:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788940645.660902:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+13:5830:x1875840068516608:12345-0@lo:101: 00010000:00010000:1.0:1788940645.660913:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940645.660924:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4142050800/0xa1d8aa9164aa2ca3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2c9c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.660946:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142050800/0xa1d8aa9164aa2ca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2c9c expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.660956:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4142050800/0xa1d8aa9164aa2ca3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2c9c expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.660964:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050800, rc 0) 00000100:00100000:1.0:1788940645.661125:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068516608:12345-0@lo:101: Request processed in 224us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940645.661132:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788940645.675808:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f871880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068516608:0@lo:101: 00010000:00010000:0.0:1788940645.675841:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ca3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.675876:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2ca3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940645.675959:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068516736:0@lo:501: 00000100:00100000:0.0:1788940645.676037:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940645.676393:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f412baef240 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.677553:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068516736 00000100:00100000:3.0:1788940645.677565:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068516736 00000100:00100000:3.0:1788940645.677636:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788940645.677645:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068516736:12345-0@lo:501: 00000100:00100000:3.0:1788940645.678123:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068516736:12345-0@lo:501: Request processed in 477us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.678278:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788940645.687921:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068516736:0@lo:501: 00000100:00100000:0.0:1788940645.688002:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068516864:0@lo:503: 00000100:00100000:0.0:1788940645.688081:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940645.688123:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f412baef240 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.688695:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068516864 00000100:00100000:3.0:1788940645.688702:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068516864 00000100:00100000:3.0:1788940645.688752:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788940645.688761:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068516864:12345-0@lo:503: 00000100:00100000:3.0:1788940645.688954:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068516864:12345-0@lo:503: Request processed in 194us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.688961:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788940645.689397:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068516864:0@lo:503: 00000100:00100000:0.0:1788940645.690563:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8454:1875840068516992:0@lo:502: 00000100:00100000:0.0:1788940645.690647:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940645.690695:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f412baef480 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.690961:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068516992 00000100:00100000:3.0:1788940645.690968:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068516992 00000100:00100000:3.0:1788940645.691020:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788940645.691029:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:8454:x1875840068516992:12345-0@lo:502: 00000100:00100000:3.0:1788940645.704024:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:8454:x1875840068516992:12345-0@lo:502: Request processed in 12988us (13369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.704038:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788940645.704713:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8454:1875840068516992:0@lo:502: 00000020:01000000:0.0:1788940645.704752:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940645.704762:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940645.704764:0:8454:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788940645.704770:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788940645.704807:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8454:1875840068517120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940645.704874:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940645.704918:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f412baef480 going to sleep for 11 seconds 00000100:00100000:1.0:1788940645.704977:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068517120 00000100:00100000:1.0:1788940645.704985:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068517120 00000100:00100000:1.0:1788940645.705048:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788940645.705057:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:8454:x1875840068517120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940645.705268:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:8454:x1875840068517120:12345-0@lo:502:llog_process_th.0 Request processed in 212us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940645.705275:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788940645.705506:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8454:1875840068517120:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940645.705528:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940645.705532:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940645.705534:0:8454:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788940645.705544:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788940645.705945:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788940645.705965:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788940645.705975:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ca3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.705985:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ca3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940645.705994:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788940645.706007:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f410f4f2000 from 39 10000000:01000000:1.0:1788940645.706009:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788940645.706037:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.706044:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.706052:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940645.706067:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068517248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940645.706108:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940645.706138:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344180 going to sleep for 11 seconds 00000100:00100000:0.0:1788940645.706240:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068517248 00000100:00100000:0.0:1788940645.706246:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068517248 00000100:00100000:0.0:1788940645.706277:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788940645.706286:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:5830:x1875840068517248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940645.706295:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940645.706306:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4136234600/0xa1d8aa9164aa2cb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2caa expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.706327:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4136234600/0xa1d8aa9164aa2cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2caa expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.706336:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4136234600/0xa1d8aa9164aa2cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2caa expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.706342:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234600, rc 0) 00000100:00100000:0.0:1788940645.706373:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068517248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940645.706379:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788940645.706509:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068517248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940645.706521:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.706529:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940645.706592:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068517376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940645.706617:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940645.706642:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344180 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.706701:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068517376 00000100:00100000:3.0:1788940645.706705:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068517376 00000100:00100000:3.0:1788940645.706738:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788940645.706745:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068517376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.706970:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068517376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.706980:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788940645.707225:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068517376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940645.707259:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068517504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940645.707296:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940645.707314:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344180 going to sleep for 11 seconds 00000100:00100000:0.0:1788940645.707381:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068517504 00000100:00100000:0.0:1788940645.707386:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068517504 00000100:00100000:0.0:1788940645.707416:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788940645.707423:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068517504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940645.707559:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068517504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940645.707566:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788940645.707654:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068517504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940645.708058:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8455:1875840068517632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940645.708095:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940645.708125:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940645.708241:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068517632 00000100:00100000:0.0:1788940645.708252:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068517632 00000100:00100000:0.0:1788940645.708276:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788940645.708289:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:8455:x1875840068517632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940645.708451:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:8455:x1875840068517632:12345-0@lo:502:llog_process_th.0 Request processed in 163us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940645.708458:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788940645.715463:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8455:1875840068517632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940645.715575:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8455:1875840068517760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940645.715665:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940645.715781:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068517760 00000100:00100000:0.0:1788940645.715790:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068517760 00000100:00100000:0.0:1788940645.715837:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788940645.715846:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:8455:x1875840068517760:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940645.716097:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:8455:x1875840068517760:12345-0@lo:502:llog_process_th.0 Request processed in 252us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940645.716105:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788940645.716670:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940645.716767:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8455:1875840068517760:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788940645.716798:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788940645.718099:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788940645.718136:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940645.718147:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.718159:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940645.718169:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788940645.718172:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788940645.718175:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788940645.718245:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.718253:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.718262:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940645.718296:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068517888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940645.718348:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940645.718382:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f412baef000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940645.718404:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068517888 00000100:00100000:0.0:1788940645.718409:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068517888 00000100:00100000:0.0:1788940645.718446:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788940645.718454:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:5830:x1875840068517888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940645.718467:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940645.718479:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4136235000/0xa1d8aa9164aa2cbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2cb8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.718503:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4136235000/0xa1d8aa9164aa2cbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2cb8 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.718513:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4136235000/0xa1d8aa9164aa2cbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2cb8 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.718520:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235000, rc 0) 00000100:00100000:0.0:1788940645.718555:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068517888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940645.718561:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788940645.718628:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068517888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940645.718641:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2cbf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.718650:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2cbf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940645.722968:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068518016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940645.723045:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940645.723086:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f412baef000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.723244:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068518016 00000100:00100000:3.0:1788940645.723252:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068518016 00000100:00100000:3.0:1788940645.723296:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788940645.723305:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068518016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.723593:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068518016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.723613:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788940645.723674:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068518016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.723719:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068518144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.723757:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.723777:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41080e2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.723789:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068518144 00000100:00100000:3.0:1788940645.723793:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068518144 00000100:00100000:3.0:1788940645.723809:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788940645.723814:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068518144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.723966:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068518144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.723973:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788940645.724005:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068518144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.724172:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8456:1875840068518272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940645.724227:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.724245:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068518272 00000100:00100000:3.0:1788940645.724249:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068518272 00000100:00100000:3.0:1788940645.724266:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788940645.724272:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:8456:x1875840068518272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940645.724389:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:8456:x1875840068518272:12345-0@lo:502:llog_process_th.0 Request processed in 116us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.724395:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788940645.724421:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41080e23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.724433:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8456:1875840068518272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940645.724459:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940645.724468:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940645.724470:0:8456:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788940645.724476:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788940645.724504:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8456:1875840068518400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940645.724533:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.724551:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068518400 00000100:00100000:3.0:1788940645.724555:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068518400 00000100:00100000:3.0:1788940645.724570:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788940645.724575:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:8456:x1875840068518400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940645.724685:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:8456:x1875840068518400:12345-0@lo:502:llog_process_th.0 Request processed in 109us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.724692:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788940645.724715:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110f4fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.724727:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8456:1875840068518400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940645.724743:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940645.724748:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940645.724749:0:8456:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788940645.724752:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788940645.724804:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788940645.724822:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788940645.724831:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2cbf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.724842:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2cbf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940645.724852:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788940645.724861:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f411876b000 from 39 10000000:01000000:3.0:1788940645.724865:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788940645.724888:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.724896:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.724905:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940645.724918:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068518528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.724940:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.724952:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110f4fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.724963:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068518528 00000100:00100000:3.0:1788940645.724966:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068518528 00000100:00100000:3.0:1788940645.724981:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788940645.724986:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068518528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940645.724993:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940645.725005:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4113b37200/0xa1d8aa9164aa2ccd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2cc6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.725026:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4113b37200/0xa1d8aa9164aa2ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2cc6 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.725037:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4113b37200/0xa1d8aa9164aa2ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2cc6 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.725045:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37200, rc 0) 00000100:00100000:3.0:1788940645.725071:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068518528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.725082:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788940645.725109:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068518528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940645.725120:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.725128:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940645.725161:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068518656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.725183:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.725215:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110f4fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.725225:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068518656 00000100:00100000:3.0:1788940645.725228:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068518656 00000100:00100000:3.0:1788940645.725243:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788940645.725248:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068518656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.725433:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068518656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.725439:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788940645.725465:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068518656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.725486:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068518784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.725517:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.725530:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110f4fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.725540:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068518784 00000100:00100000:3.0:1788940645.725543:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068518784 00000100:00100000:3.0:1788940645.725560:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788940645.725571:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068518784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.725697:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068518784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.725703:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788940645.725734:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068518784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.725960:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8457:1875840068518912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940645.725991:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.726008:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068518912 00000100:00100000:3.0:1788940645.726011:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068518912 00000100:00100000:3.0:1788940645.726029:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788940645.726034:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:8457:x1875840068518912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940645.726182:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:8457:x1875840068518912:12345-0@lo:502:llog_process_th.0 Request processed in 140us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.726213:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788940645.726238:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4115c4ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.726249:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8457:1875840068518912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940645.726287:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8457:1875840068519040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940645.726316:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.726334:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068519040 00000100:00100000:3.0:1788940645.726337:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068519040 00000100:00100000:3.0:1788940645.726353:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788940645.726358:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:8457:x1875840068519040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940645.726468:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:8457:x1875840068519040:12345-0@lo:502:llog_process_th.0 Request processed in 110us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.726484:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788940645.726509:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41080e2840 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.726520:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8457:1875840068519040:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788940645.726537:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788940645.734407:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788940645.734443:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788940645.734457:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.734469:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940645.734480:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788940645.734482:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788940645.734485:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788940645.734527:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.734535:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.734547:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940645.734573:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068519168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.734648:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.735826:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41080e2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788940645.738802:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068519168 00000100:00100000:0.0:1788940645.738819:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068519168 00000100:00100000:0.0:1788940645.738933:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788940645.738943:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068519168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940645.738960:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940645.738978:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4136235800/0xa1d8aa9164aa2cdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2cd4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.739018:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4136235800/0xa1d8aa9164aa2cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2cd4 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.739029:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4136235800/0xa1d8aa9164aa2cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2cd4 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.739037:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235800, rc 0) 00000100:00100000:0.0:1788940645.739122:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068519168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (4473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940645.739138:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788940645.739241:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068519168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940645.739274:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.739284:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940645.739354:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068519296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.739386:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940645.749762:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068519296 00000100:00100000:1.0:1788940645.749780:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068519296 00000100:00100000:1.0:1788940645.749833:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788940645.749843:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068519296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940645.750134:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068519296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (10747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940645.750142:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788940645.750252:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41080e2840 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.750280:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068519296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.750329:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068519424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.750377:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940645.750396:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41080e2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788940645.752586:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068519424 00000100:00100000:0.0:1788940645.752601:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068519424 00000100:00100000:0.0:1788940645.752660:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788940645.752670:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068519424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940645.753502:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068519424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 829us (3122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940645.753521:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788940645.754830:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068519424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940645.762500:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a66c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8458:1875840068519552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940645.762607:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940645.762661:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41109d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788940645.762772:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068519552 00000100:00100000:0.0:1788940645.762780:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068519552 00000100:00100000:0.0:1788940645.762837:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788940645.762847:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:8458:x1875840068519552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940645.763113:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:8458:x1875840068519552:12345-0@lo:502:llog_process_th.0 Request processed in 267us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940645.763121:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788940645.763440:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a66c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8458:1875840068519552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940645.763474:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940645.763485:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940645.763487:0:8458:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788940645.763497:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788940645.763518:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a66c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8458:1875840068519680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940645.763554:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940645.763599:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41109d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788940645.763644:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068519680 00000100:00100000:0.0:1788940645.763649:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068519680 00000100:00100000:0.0:1788940645.763693:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788940645.763700:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:8458:x1875840068519680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940645.763861:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:8458:x1875840068519680:12345-0@lo:502:llog_process_th.0 Request processed in 161us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940645.763868:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788940645.764010:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a66c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8458:1875840068519680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940645.764031:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940645.764036:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940645.764037:0:8458:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788940645.764042:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788940645.764292:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788940645.764323:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788940645.764333:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.764345:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940645.764356:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788940645.764359:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f4118288000 from 1 10000000:01000000:0.0:1788940645.764361:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788940645.764387:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136234e00/0xa1d8aa9164aa2ce2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.764402:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4136234e00/0xa1d8aa9164aa2ce2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.764412:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4136234e00/0xa1d8aa9164aa2ce2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940645.764425:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068519808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940645.764456:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940645.764489:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f412baef240 going to sleep for 11 seconds 00000100:00100000:3.0:1788940645.764534:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068519808 00000100:00100000:3.0:1788940645.764539:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068519808 00000100:00100000:3.0:1788940645.764574:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788940645.764592:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068519808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940645.764601:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940645.764615:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4113b37600/0xa1d8aa9164aa2ce9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2ce2 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.764651:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4113b37600/0xa1d8aa9164aa2ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ce2 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.764662:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4113b37600/0xa1d8aa9164aa2ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ce2 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940645.764671:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37600, rc 0) 00000100:00100000:3.0:1788940645.764721:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068519808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.764728:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788940645.764854:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068519808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940645.764868:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4136234e00/0xa1d8aa9164aa2ce2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ce9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.764878:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4136234e00/0xa1d8aa9164aa2ce2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2ce9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940645.764930:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068519936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940645.764961:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940645.764984:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f412baef240 going to sleep for 11 seconds 00000100:00100000:0.0:1788940645.765009:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068519936 00000100:00100000:0.0:1788940645.765013:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068519936 00000100:00100000:0.0:1788940645.765031:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788940645.765036:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068519936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940645.765294:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068519936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (331us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940645.765301:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788940645.765338:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068519936:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788940645.765357:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788940645.765363:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136234e00/0xa1d8aa9164aa2ce2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ce9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940645.765371:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4136234e00/0xa1d8aa9164aa2ce2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ce9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940645.864849:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940645.864963:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035984128 00000100:00100000:0.0:1788940645.864981:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035984128 00000100:00100000:0.0:1788940645.865064:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 168 00000100:00100000:0.0:1788940645.865076:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+8:5605:x1875840035984128:12345-192.168.202.17@tcp:101: 00010000:00010000:0.0:1788940645.865095:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940645.865816:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4136235400/0xa1d8aa9164aa2cf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22633b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.865956:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4136235400/0xa1d8aa9164aa2cf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22633b expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.865978:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4136235400/0xa1d8aa9164aa2cf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22633b expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.865989:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235400, rc 0) 00000100:00100000:1.0:1788940645.866095:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+9:5605:x1875840035984128:12345-192.168.202.17@tcp:101: Request processed in 1020us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940645.866105:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 168 00000100:00100000:1.0:1788940645.875760:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940645.875886:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035984256 00000100:00100000:2.0:1788940645.875901:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035984256 00000100:00100000:2.0:1788940645.875988:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 169 00000100:00100000:2.0:1788940645.875999:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+9:5605:x1875840035984256:12345-192.168.202.17@tcp:501: 00000100:00100000:2.0:1788940645.876464:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+9:5605:x1875840035984256:12345-192.168.202.17@tcp:501: Request processed in 464us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940645.876473:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 169 00000100:00100000:2.0:1788940645.881486:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940645.881673:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035984384 00000100:00100000:1.0:1788940645.881688:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035984384 00000100:00100000:1.0:1788940645.881764:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 170 00000100:00100000:1.0:1788940645.881776:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+9:5605:x1875840035984384:12345-192.168.202.17@tcp:503: 00000100:00100000:1.0:1788940645.882338:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+9:5605:x1875840035984384:12345-192.168.202.17@tcp:503: Request processed in 561us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940645.882349:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 170 00000100:00100000:1.0:1788940645.891856:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940645.892615:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035984512 00000100:00100000:2.0:1788940645.892632:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035984512 00000100:00100000:2.0:1788940645.892733:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 171 00000100:00100000:2.0:1788940645.892746:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+9:6078:x1875840035984512:12345-192.168.202.17@tcp:502: 00000100:00100000:2.0:1788940645.893171:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+9:6078:x1875840035984512:12345-192.168.202.17@tcp:502: Request processed in 425us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940645.893180:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 171 00000100:00100000:2.0:1788940645.896662:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940645.896832:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035984640 00000100:00100000:3.0:1788940645.896847:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035984640 00000100:00100000:3.0:1788940645.896950:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 172 00000100:00100000:3.0:1788940645.896963:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+9:6078:x1875840035984640:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940645.898375:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+9:6078:x1875840035984640:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 1403us (1719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940645.898389:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 172 00000100:00100000:3.0:1788940645.935836:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940645.936663:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035984768 00000100:00100000:1.0:1788940645.936680:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035984768 00000100:00100000:1.0:1788940645.936763:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 173 00000100:00100000:1.0:1788940645.936776:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+9:5605:x1875840035984768:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940645.936800:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940645.936828:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2cf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226342 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.936881:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2cf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226342 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.936895:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2cf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226342 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940645.936907:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142051e00, rc 0) 00000100:00100000:1.0:1788940645.937010:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:5605:x1875840035984768:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 Request processed in 236us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940645.937018:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 173 00000100:00100000:0.0:1788940645.939987:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940645.940238:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035984896 00000100:00100000:3.0:1788940645.940252:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035984896 00000100:00100000:3.0:1788940645.940327:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 174 00000100:00100000:3.0:1788940645.940339:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+10:5605:x1875840035984896:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940645.940749:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+10:5605:x1875840035984896:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 Request processed in 410us (776us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940645.940759:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 174 00010000:00010000:0.0:1788940645.962323:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940646.408691:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068520064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940646.408808:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940646.409250:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068520064 00000100:00100000:0.0:1788940646.409263:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068520064 00000100:00100000:0.0:1788940646.409354:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788940646.409366:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068520064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940646.409416:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940646.409478:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068520064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940646.409486:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788940646.409587:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41129dea00 x1875840068520064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940662 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940646.409636:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068520064:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788940646.409813:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788940646.984574:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940647.597776:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940647.597829:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940647.597871:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940647.597912:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940647.597953:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035985408 00000100:00100000:2.0:1788940647.597966:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035985408 00000100:00100000:2.0:1788940647.598049:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035985280 00000100:00100000:2.0:1788940647.598053:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035985280 00000100:00100000:2.0:1788940647.598080:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:2.0:1788940647.598096:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840035985408:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940647.598229:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840035985408:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 139us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940647.598237:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:2.0:1788940647.598256:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00100000:2.0:1788940647.598264:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840035985280:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940647.598294:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840035985280:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 32us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940647.598300:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00080000:2.0:1788940647.598317:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940647.598336:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940647.599069:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035985152 00000100:00100000:3.0:1788940647.599078:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035985152 00000100:00100000:3.0:1788940647.599148:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 36 00000100:00100000:3.0:1788940647.599157:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2361:x1875840035985152:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940647.599242:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2361:x1875840035985152:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 85us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940647.599250:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 36 00000100:00100000:3.0:1788940647.599276:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035985024 00000100:00100000:3.0:1788940647.599281:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035985024 00000100:00100000:3.0:1788940647.599306:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 175 00000100:00100000:3.0:1788940647.599313:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+10:2361:x1875840035985024:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940647.599341:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+10:2361:x1875840035985024:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 29us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940647.599348:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 175 00000100:00080000:2.0:1788940647.599771:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788940648.011837:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788940648.393394:0:8496:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe795db8f0 20000000:00000080:1.0:1788940648.393420:0:8496:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f413f234400 uarg=0000000000000000 20000000:01000000:1.0:1788940648.393476:0:8496:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788940648.393483:0:8496:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788940648.393489:0:8496:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788940648.395035:0:8497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788940648.395423:0:8496:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788940648.404975:0:8496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788940648.405042:0:8496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788940648.405107:0:8496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788940648.408257:0:8496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788940648.408321:0:8496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.408346:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4113b36600/0xa1d8aa9164aa2a73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2a6c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.408355:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ad5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ace expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.408362:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4100030e00/0xa1d8aa9164aa2ba0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2b99 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.408372:0:8496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4100031800/0xa1d8aa9164aa2c5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22630a expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.408379:0:8496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.408427:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4100031800/0xa1d8aa9164aa2c5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22630a expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.408444:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f4100031800/0xa1d8aa9164aa2c5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22630a expref: 9 pid: 5827 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940648.408459:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875840068520192:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940648.408573:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4100030e00/0xa1d8aa9164aa2ba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2b99 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.408583:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4100030e00/0xa1d8aa9164aa2ba0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b99 expref: 18 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940648.408603:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875840068520320:0@lo:104: 00000100:00100000:1.0:1788940648.408652:0:8496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940648.408695:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ad5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2ace expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.408704:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ad5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ace expref: 18 pid: 5827 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940648.408712:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875840068520448:0@lo:104: 00000100:00100000:1.0:1788940648.408737:0:8496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940648.408769:0:8496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4113b36600/0xa1d8aa9164aa2a73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2a6c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.408777:0:8496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4113b36600/0xa1d8aa9164aa2a73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a6c expref: 18 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940648.408786:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875840068520576:0@lo:104: 00000100:00100000:1.0:1788940648.408813:0:8496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940648.408830:0:8496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1799c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940648.408853:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068520320 00000100:00100000:3.0:1788940648.408871:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068520320 00000100:00100000:3.0:1788940648.408946:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068520448 00000100:00100000:3.0:1788940648.408950:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068520448 00000100:00100000:3.0:1788940648.408962:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068520576 00000100:00100000:3.0:1788940648.408965:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068520576 00000100:00100000:3.0:1788940648.408985:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788940648.408996:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+5:8496:x1875840068520320:12345-0@lo:104: 00010000:00010000:3.0:1788940648.409017:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2ba0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940648.409154:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940648.409161:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+5:8496:x1875840068520320:12345-0@lo:104: Request processed in 167us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940648.409170:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788940648.409228:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788940648.409236:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+4:8496:x1875840068520448:12345-0@lo:104: 00010000:00010000:3.0:1788940648.409245:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2ad5 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940648.409280:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940648.409286:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+4:8496:x1875840068520448:12345-0@lo:104: Request processed in 52us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940648.409291:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788940648.409340:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788940648.409345:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:8496:x1875840068520576:12345-0@lo:104: 00010000:00010000:3.0:1788940648.409353:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa2a6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2a73 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940648.409384:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788940648.409388:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:8496:x1875840068520576:12345-0@lo:104: Request processed in 44us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940648.409394:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788940648.409612:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788940648.409621:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2ba0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940648.409630:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050400 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:0.0:1788940648.409636:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2ba0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940648.409646:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2ba0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940648.409654:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2ba0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940648.409660:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788940648.409759:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2ba0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940648.409767:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940648.409792:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2ba0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940648.409800:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4142050400/0xa1d8aa9164aa2b99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2ba0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940648.409816:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940648.409830:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2ad5 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940648.409848:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7200 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:0.0:1788940648.409851:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2ad5 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940648.409858:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2ad5 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940648.409865:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2ad5 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940648.409871:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788940648.411433:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940648.411446:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa2a6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2a73 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.411459:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030a00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:2.0:1788940648.411464:0:7620:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa2a6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2a73 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.411475:0:7620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa2a6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2a73 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940648.411482:0:7620:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa2a6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2a73 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940648.411489:0:7620:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788940648.411618:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875840068520320:0@lo:104: 00000100:00100000:1.0:1788940648.411632:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875840068520448:0@lo:104: 00000100:00100000:1.0:1788940648.411641:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875840068520576:0@lo:104: 00010000:00010000:3.0:1788940648.415147:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940648.415334:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00010000:00010000:0.0:1788940648.415339:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2ad5 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940648.415355:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940648.415390:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2ad5 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940648.415398:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7200/0xa1d8aa9164aa2ace lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2ad5 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940648.415400:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035985536 00000100:00100000:1.0:1788940648.415413:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035985536 00010000:00010000:0.0:1788940648.415422:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940648.415426:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940648.415428:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940648.415453:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068520704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940648.415463:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4100031800/0xa1d8aa9164aa2c5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22630a expref: 10 pid: 5827 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940648.415526:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 21 00000100:00100000:0.0:1788940648.415538:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940648.415547:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd220973-afce-4e0b-b310-f94af7a18e79+10:2358:x1875840035985536:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940648.415577:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940648.415587:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4100031800/0xa1d8aa9164aa2c5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22630a expref: 10 pid: 5827 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.415609:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4100031800/0xa1d8aa9164aa2c5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22630a expref: 10 pid: 5827 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.415632:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940648.415649:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068520832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940648.415696:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd220973-afce-4e0b-b310-f94af7a18e79+10:2358:x1875840035985536:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 157us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940648.415706:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940648.415719:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 21 00000100:00100000:0.0:1788940648.415758:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068520704 00000100:00100000:1.0:1788940648.415762:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068520832 00000100:00100000:0.0:1788940648.415767:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068520704 00000100:00100000:1.0:1788940648.415770:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068520832 00010000:00010000:1.0:1788940648.415797:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ad5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ace expref: 20 pid: 5827 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940648.415804:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4100030e00/0xa1d8aa9164aa2ba0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b99 expref: 20 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940648.415820:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788940648.415829:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+20:3301:x1875840068520832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940648.415838:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940648.415843:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ad5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ace expref: 20 pid: 5827 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.415853:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ad5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ace expref: 20 pid: 5827 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.415877:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ad5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2ace expref: 20 pid: 5827 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940648.415888:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940648.415943:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068520832:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (243us total) trans 0 rc 0/0 00010000:00010000:3.0:1788940648.415997:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4100031800/0xa1d8aa9164aa2c5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22630a expref: 9 pid: 5827 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940648.416012:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8496:1875840068520192:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940648.416077:0:8496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940648.416286:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788940648.416296:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068520704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940648.416310:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940648.416315:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4100030e00/0xa1d8aa9164aa2ba0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b99 expref: 19 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940648.416326:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4100030e00/0xa1d8aa9164aa2ba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b99 expref: 19 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940648.416340:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4100030e00/0xa1d8aa9164aa2ba0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2b99 expref: 19 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940648.416350:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940648.416384:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:3304:x1875840068520704:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940648.416391:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788940648.416419:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068520832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940648.416434:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068520704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940648.417364:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1788940648.423150:0:7620:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa2a6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a73 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.423169:0:7620:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940648.423517:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa2a6c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a73 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.423528:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa2a6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2a73 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940648.423534:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068520960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940648.423569:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940648.423573:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940648.423576:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940648.423660:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940648.423806:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068520960 00000100:00100000:2.0:1788940648.423834:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068520960 00010000:00010000:2.0:1788940648.423877:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4113b36600/0xa1d8aa9164aa2a73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a6c expref: 17 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940648.423996:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788940648.424006:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:3302:x1875840068520960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940648.424024:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940648.424029:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4113b36600/0xa1d8aa9164aa2a73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a6c expref: 17 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.424040:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4113b36600/0xa1d8aa9164aa2a73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a6c expref: 17 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.424055:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4113b36600/0xa1d8aa9164aa2a73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2a6c expref: 17 pid: 5826 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.424073:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.424080:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.424096:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.424102:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.424107:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.424113:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.424123:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940648.424127:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.424133:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.424141:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940648.424149:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940648.424301:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:3302:x1875840068520960:12345-0@lo:103:ldlm_bl.0 Request processed in 296us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940648.424308:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788940648.424332:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068520960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940648.424419:0:8496:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940648.424428:0:8496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940648.424432:0:8496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142051c00/0xa1d8aa9164aa2cfe lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.033309:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940649.482868:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068521088:0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.482991:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940649.483045:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068521600:0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.483074:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940649.483103:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788940649.483109:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068521216:0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.483132:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940649.483151:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068521728:0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.483176:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940649.483225:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068521344:0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.483249:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940649.483268:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940649.483272:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068521472:0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.483294:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940649.483327:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068521088 00000100:00100000:1.0:1788940649.483338:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068521088 00000100:00100000:1.0:1788940649.483398:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788940649.483419:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:3303:x1875840068521088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.483478:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:3303:x1875840068521088:12345-0@lo:400:kworker.0 Request processed in 62us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940649.483486:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788940649.483523:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068521600 00000100:00100000:1.0:1788940649.483527:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068521600 00000100:00100000:1.0:1788940649.483575:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068521216 00000100:00100000:1.0:1788940649.483579:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068521216 00000100:00100000:1.0:1788940649.483589:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068521344 00000100:00100000:1.0:1788940649.483591:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068521344 00000100:00100000:1.0:1788940649.483603:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788940649.483609:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068521600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.483640:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068521600:12345-0@lo:400:kworker.0 Request processed in 32us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940649.483646:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788940649.483656:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788940649.483661:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068521216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.483683:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068521216:12345-0@lo:400:kworker.0 Request processed in 22us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940649.483689:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788940649.483698:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788940649.483702:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068521344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.483726:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068521344:12345-0@lo:400:kworker.0 Request processed in 24us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940649.483731:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788940649.483750:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068521728 00000100:00100000:1.0:1788940649.483754:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068521728 00000100:00100000:1.0:1788940649.483787:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068521472 00000100:00100000:1.0:1788940649.483790:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068521472 00000100:00100000:1.0:1788940649.483810:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788940649.483815:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068521728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.483844:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068521728:12345-0@lo:400:kworker.0 Request processed in 30us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940649.483850:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788940649.483859:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788940649.483864:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068521472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.483886:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068521472:12345-0@lo:400:kworker.0 Request processed in 22us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940649.483891:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788940649.483944:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068521216:0@lo:400:kworker.0 00010000:00080000:1.0:1788940649.483957:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4141513b80 x1875840068521728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940649.483967:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068521728:0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.483975:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068521088:0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.483984:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068521600:0@lo:400:kworker.0 00000100:00080000:1.0:1788940649.484012:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940649.484017:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940649.484020:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788940649.484038:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4141510380 x1875840068521472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940649.484046:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068521472:0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.484066:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068521344:0@lo:400:kworker.0 00000100:00100000:1.0:1788940649.658032:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940649.658164:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035985664 00000100:00100000:2.0:1788940649.658179:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035985664 00000100:00100000:2.0:1788940649.659424:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 177 00000100:00100000:2.0:1788940649.659453:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+9:5605:x1875840035985664:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940649.659966:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940649.660020:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2d05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226349 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.668693:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226349 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.668722:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226349 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940649.668748:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6400, rc 0) 00000100:00100000:2.0:1788940649.668852:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:5605:x1875840035985664:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 Request processed in 9406us (10833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940649.668863:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 177 00000100:00100000:1.0:1788940649.677982:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940649.678141:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035985792 00000100:00100000:3.0:1788940649.678156:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035985792 00000100:00100000:3.0:1788940649.678250:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 178 00000100:00100000:3.0:1788940649.678263:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+10:5605:x1875840035985792:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940649.678693:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+10:5605:x1875840035985792:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 Request processed in 430us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940649.678703:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 178 00000100:00100000:1.0:1788940649.686288:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940649.687006:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035985920 00000100:00100000:2.0:1788940649.687022:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035985920 00000100:00100000:2.0:1788940649.687102:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 179 00000100:00100000:2.0:1788940649.687114:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:5605:x1875840035985920:12345-192.168.202.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940649.687557:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:5605:x1875840035985920:12345-192.168.202.17@tcp:503:ll_cfg_requeue.0 Request processed in 443us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940649.687567:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 179 00000100:00100000:2.0:1788940649.696064:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940649.696837:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035986048 00000100:00100000:0.0:1788940649.696879:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035986048 00000100:00100000:0.0:1788940649.696965:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 180 00000100:00100000:0.0:1788940649.696978:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:6135:x1875840035986048:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940649.697588:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:6135:x1875840035986048:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 609us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940649.697599:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 180 00000100:00100000:1.0:1788940649.715596:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940649.715729:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035986176 00000100:00100000:3.0:1788940649.715744:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035986176 00000100:00100000:3.0:1788940649.715820:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 181 00000100:00100000:3.0:1788940649.715846:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:6135:x1875840035986176:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940649.716232:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:6135:x1875840035986176:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 387us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940649.716242:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 181 00000100:00100000:0.0:1788940650.005916:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068521856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940650.005992:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940650.016158:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068521856 00000100:00100000:0.0:1788940650.016174:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068521856 00000100:00100000:0.0:1788940650.016953:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788940650.016966:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068521856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940650.017011:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940650.017120:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068521856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (11127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940650.017128:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788940650.017261:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f411129bb80 x1875840068521856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940650.017284:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068521856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788940650.063502:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788940650.313252:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788940650.313338:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f413f3b7800 from 4 10000000:01000000:3.0:1788940650.313352:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940650.313418:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.313433:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940650.313448:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940650.313483:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068521984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940650.313750:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940650.313817:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068521984 00000100:00100000:0.0:1788940650.313829:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068521984 00000100:00100000:0.0:1788940650.313896:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788940650.313907:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068521984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940650.313924:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940650.313940:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4136234200/0xa1d8aa9164aa2d13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2d0c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.313966:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4136234200/0xa1d8aa9164aa2d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d0c expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.313988:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4136234200/0xa1d8aa9164aa2d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d0c expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.313999:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234200, rc 0) 00000100:00100000:3.0:1788940650.314072:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41109d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788940650.315881:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068521984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1965us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940650.315895:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788940650.315997:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068521984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940650.316026:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d13 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940650.316039:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2d13 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940650.316132:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068522112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940650.316174:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940650.316350:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410a7509c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940650.316394:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068522112 00000100:00100000:0.0:1788940650.316402:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068522112 00000100:00100000:0.0:1788940650.316480:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788940650.316492:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068522112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.316849:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068522112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 358us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940650.316856:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788940650.317102:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068522112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.317157:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068522240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.317455:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940650.317702:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1ea600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940650.317745:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068522240 00000100:00100000:2.0:1788940650.317753:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068522240 00000100:00100000:2.0:1788940650.317833:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788940650.317850:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068522240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940650.318059:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068522240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940650.318067:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788940650.318137:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068522240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.318475:0:8558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8558:1875840068522368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940650.318730:0:8558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940650.318764:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068522368 00000100:00100000:0.0:1788940650.318770:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068522368 00000100:00100000:0.0:1788940650.318805:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788940650.318820:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:8558:x1875840068522368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940650.318983:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:8558:x1875840068522368:12345-0@lo:502:llog_process_th.0 Request processed in 164us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940650.318991:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788940650.319037:0:8558:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1ea900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940650.319051:0:8558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8558:1875840068522368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940650.319076:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940650.319088:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940650.319092:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788940650.319100:0:8558:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f413f3b7800 00000020:00000080:0.0:1788940650.319103:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788940650.319222:0:8558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8558:1875840068522496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940650.319329:0:8558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940650.319349:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068522496 00000100:00100000:0.0:1788940650.319353:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068522496 00000100:00100000:0.0:1788940650.319375:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788940650.319381:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:8558:x1875840068522496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940650.319492:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:8558:x1875840068522496:12345-0@lo:502:llog_process_th.0 Request processed in 110us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940650.319760:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788940650.319799:0:8558:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1ea900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940650.319813:0:8558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8558:1875840068522496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940650.319833:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940650.319838:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940650.319840:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788940650.319844:0:8558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788940650.319916:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788940650.319945:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940650.319957:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d13 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.319972:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d13 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940650.319984:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788940650.319987:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f410f4f2000 from 4 10000000:01000000:0.0:1788940650.319990:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940650.320019:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.320028:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.320039:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940650.320054:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068522624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.320090:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940650.320105:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1ea900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940650.320119:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068522624 00000100:00100000:0.0:1788940650.320123:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068522624 00000100:00100000:0.0:1788940650.320148:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788940650.320155:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068522624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940650.320167:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940650.320180:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4136234400/0xa1d8aa9164aa2d21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2d1a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.320317:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4136234400/0xa1d8aa9164aa2d21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d1a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.320331:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4136234400/0xa1d8aa9164aa2d21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d1a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.320343:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234400, rc 0) 00000100:00100000:0.0:1788940650.320375:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068522624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940650.320381:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788940650.320413:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068522624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940650.320427:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d21 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.320437:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2d21 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940650.320487:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068522752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.320801:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940650.320828:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1ea900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940650.320845:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068522752 00000100:00100000:0.0:1788940650.320849:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068522752 00000100:00100000:0.0:1788940650.320878:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788940650.320886:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068522752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.321175:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068522752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940650.321212:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788940650.321434:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068522752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.321469:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068522880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.321601:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940650.321675:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1ea900 going to sleep for 11 seconds 00000100:00100000:2.0:1788940650.321945:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068522880 00000100:00100000:2.0:1788940650.321952:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068522880 00000100:00100000:2.0:1788940650.322033:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788940650.322045:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068522880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940650.322295:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068522880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940650.322303:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788940650.322471:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068522880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.322734:0:8559:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8559:1875840068523008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940650.322786:0:8559:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940650.322812:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068523008 00000100:00100000:0.0:1788940650.322816:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068523008 00000100:00100000:0.0:1788940650.322842:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788940650.322850:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:8559:x1875840068523008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940650.322993:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:8559:x1875840068523008:12345-0@lo:502:llog_process_th.0 Request processed in 144us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940650.323000:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788940650.323042:0:8559:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1ea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940650.323054:0:8559:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8559:1875840068523008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940650.323077:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940650.323089:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940650.323092:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788940650.323101:0:8559:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f410f4f2000 00000020:00000080:0.0:1788940650.323104:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788940650.323215:0:8559:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8559:1875840068523136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940650.323397:0:8559:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940650.323425:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068523136 00000100:00100000:0.0:1788940650.323429:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068523136 00000100:00100000:0.0:1788940650.323452:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788940650.323458:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:8559:x1875840068523136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940650.323644:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:8559:x1875840068523136:12345-0@lo:502:llog_process_th.0 Request processed in 184us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940650.323650:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788940650.323689:0:8559:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1ea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940650.323703:0:8559:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8559:1875840068523136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940650.323723:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940650.323728:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940650.323730:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788940650.323733:0:8559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788940650.323794:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788940650.323813:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940650.323824:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d21 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.323837:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d21 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940650.323851:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788940650.323854:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f411876b000 from 4 10000000:01000000:0.0:1788940650.323857:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940650.323887:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.323895:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.323917:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940650.323931:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068523264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.323963:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940650.323977:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1ea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940650.323989:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068523264 00000100:00100000:0.0:1788940650.323992:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068523264 00000100:00100000:0.0:1788940650.324016:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788940650.324023:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4107279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068523264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940650.324033:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940650.324048:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4136235600/0xa1d8aa9164aa2d2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2d28 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.324074:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4136235600/0xa1d8aa9164aa2d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d28 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.324085:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4136235600/0xa1d8aa9164aa2d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d28 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.324095:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235600, rc 0) 00000100:00100000:0.0:1788940650.324122:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4107279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068523264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940650.324128:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788940650.324156:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068523264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940650.324168:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d2f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940650.324184:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2d2f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940650.326379:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068523392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.326449:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940650.326486:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1ea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940650.326528:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068523392 00000100:00100000:0.0:1788940650.326543:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068523392 00000100:00100000:0.0:1788940650.326589:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788940650.326599:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410727b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068523392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.326890:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410727b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068523392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940650.326899:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788940650.326950:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068523392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.326981:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068523520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940650.327019:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940650.327036:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1ea3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940650.329469:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068523520 00000100:00100000:2.0:1788940650.329488:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068523520 00000100:00100000:2.0:1788940650.332181:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788940650.332212:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068523520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940650.333417:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068523520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1204us (6391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940650.333433:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788940650.333621:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141510380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068523520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940650.334162:0:8561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8561:1875840068523648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940650.336975:0:8561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940650.337034:0:8561:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003b15480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940650.344980:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068523648 00000100:00100000:0.0:1788940650.345002:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068523648 00000100:00100000:0.0:1788940650.345072:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788940650.345085:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:8561:x1875840068523648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940650.345837:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:8561:x1875840068523648:12345-0@lo:502:llog_process_th.0 Request processed in 750us (8867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940650.345849:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788940650.346807:0:8561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8561:1875840068523648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940650.346863:0:8561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940650.346883:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940650.346886:0:8561:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788940650.346896:0:8561:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f411876b000 00000020:00000080:2.0:1788940650.346899:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788940650.347008:0:8561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8561:1875840068523776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940650.347079:0:8561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940650.347120:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068523776 00000100:00100000:2.0:1788940650.347127:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068523776 00000100:00100000:2.0:1788940650.347178:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788940650.347211:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:8561:x1875840068523776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940650.347454:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:8561:x1875840068523776:12345-0@lo:502:llog_process_th.0 Request processed in 266us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940650.347463:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788940650.347517:0:8561:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003b15480 going to sleep for 11 seconds 00000100:00100000:2.0:1788940650.347530:0:8561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:8561:1875840068523776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940650.347568:0:8561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940650.347573:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940650.347574:0:8561:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788940650.347578:0:8561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788940650.347661:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788940650.347687:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940650.347698:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d2f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940650.347712:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d2f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940651.093972:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940651.532692:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068523904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940651.532794:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940651.533346:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068523904 00000100:00100000:1.0:1788940651.533358:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068523904 00000100:00100000:1.0:1788940651.533430:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788940651.533440:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068523904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940651.533489:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940651.533565:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068523904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940651.533573:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788940651.533597:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940651.543797:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4141513100 x1875840068523904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940651.543837:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068523904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788940652.105378:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940652.722015:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940652.722072:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940652.722137:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940652.722176:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940652.722270:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035986560 00000100:00100000:1.0:1788940652.722286:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035986560 00000100:00100000:1.0:1788940652.722380:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035986688 00000100:00100000:1.0:1788940652.722384:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035986688 00000100:00100000:1.0:1788940652.722413:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 22 00000100:00100000:1.0:1788940652.722424:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2359:x1875840035986560:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940652.722530:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2359:x1875840035986560:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 107us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940652.722538:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 22 00000100:00100000:1.0:1788940652.722559:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 23 00000100:00100000:1.0:1788940652.722566:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2359:x1875840035986688:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940652.722591:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2359:x1875840035986688:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940652.722596:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 23 00000100:00080000:1.0:1788940652.722614:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940652.722618:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940652.723119:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035986432 00000100:00100000:0.0:1788940652.723127:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035986432 00000100:00100000:0.0:1788940652.723223:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 40 00000100:00100000:0.0:1788940652.723233:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035986432:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940652.723279:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035986432:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 48us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940652.723286:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 40 00000100:00100000:2.0:1788940652.723922:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035986304 00000100:00100000:2.0:1788940652.723930:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035986304 00000100:00100000:2.0:1788940652.724177:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 197 00000100:00100000:2.0:1788940652.724226:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840035986304:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940652.724281:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840035986304:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 60us (2283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940652.724289:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 197 00000100:00080000:1.0:1788940652.724644:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788940653.132355:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940654.152407:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940654.607693:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068524032:0@lo:400:kworker.0 00000100:00100000:0.0:1788940654.607774:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940654.607832:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068524544:0@lo:400:kworker.0 00000100:00100000:0.0:1788940654.607858:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940654.607885:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788940654.607900:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068524160:0@lo:400:kworker.0 00000100:00100000:0.0:1788940654.607924:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940654.607941:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068524672:0@lo:400:kworker.0 00000100:00100000:0.0:1788940654.607964:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940654.608834:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068524032 00000100:00100000:3.0:1788940654.608846:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068524032 00000100:00100000:3.0:1788940654.608906:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788940654.608915:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068524032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940654.608977:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068524032:12345-0@lo:400:kworker.0 Request processed in 63us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940654.608985:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788940654.609033:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068524032:0@lo:400:kworker.0 00000100:00100000:0.0:1788940654.610582:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068524544 00000100:00100000:0.0:1788940654.610598:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068524544 00000100:00100000:0.0:1788940654.610655:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068524160 00000100:00100000:0.0:1788940654.610658:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068524160 00000100:00100000:0.0:1788940654.610686:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788940654.610695:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068524544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940654.610770:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068524544:12345-0@lo:400:kworker.0 Request processed in 77us (2910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940654.610778:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788940654.610793:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940654.610815:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068524160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940654.610843:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141513100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068524160:12345-0@lo:400:kworker.0 Request processed in 29us (2919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940654.610849:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940654.610875:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068524416:0@lo:400:kworker.0 00000100:00100000:0.0:1788940654.610939:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940654.610970:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940654.610977:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068524288:0@lo:400:kworker.0 00000100:00100000:0.0:1788940654.611000:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788940654.611030:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940654.611044:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068524288 00000100:00100000:0.0:1788940654.611047:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068524288 00000100:00100000:0.0:1788940654.611074:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940654.611080:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068524288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940654.611111:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068524288:12345-0@lo:400:kworker.0 Request processed in 31us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940654.611116:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940654.611132:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068524672 00000100:00100000:0.0:1788940654.611136:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068524672 00000100:00100000:0.0:1788940654.611161:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068524416 00000100:00100000:0.0:1788940654.611164:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068524416 00000100:00100000:0.0:1788940654.611184:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788940654.611212:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068524672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940654.611242:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141510380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068524672:12345-0@lo:400:kworker.0 Request processed in 32us (3276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940654.611248:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788940654.611261:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788940654.611273:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068524416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940654.611302:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068524416:12345-0@lo:400:kworker.0 Request processed in 29us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940654.611307:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788940654.611327:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940654.611329:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940654.611331:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940654.611355:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068524288:0@lo:400:kworker.0 00010000:00080000:0.0:1788940654.611368:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f411141fb80 x1875840068524416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940654.611379:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068524416:0@lo:400:kworker.0 00000100:00100000:3.0:1788940654.611563:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068524160:0@lo:400:kworker.0 00010000:00080000:3.0:1788940654.611576:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41129df480 x1875840068524672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940654.611586:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068524672:0@lo:400:kworker.0 00000100:00100000:3.0:1788940654.611597:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068524544:0@lo:400:kworker.0 00000100:00100000:0.0:1788940655.113259:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068524800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940655.113337:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940655.113443:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068524800 00000100:00100000:1.0:1788940655.113452:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068524800 00000100:00100000:1.0:1788940655.113514:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788940655.113524:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068524800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940655.113562:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940655.113624:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068524800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940655.113632:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788940655.113784:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41129df480 x1875840068524800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940655.113804:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068524800:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940655.184300:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940656.201467:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940656.654813:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940656.654834:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068524928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940656.655039:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940656.655351:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068524928 00000100:00100000:2.0:1788940656.655360:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068524928 00000100:00100000:2.0:1788940656.655429:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788940656.655439:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068524928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940656.655471:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940656.655529:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068524928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940656.655535:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788940656.657505:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940656.659288:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4002583480 x1875840068524928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940656.659316:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068524928:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788940656.962496:0:8797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg217-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788940657.224339:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940657.836598:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940657.836643:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940657.836680:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035986816 00000100:00100000:1.0:1788940657.836690:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035986816 00000100:00100000:1.0:1788940657.836753:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 199 00000100:00100000:1.0:1788940657.836764:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840035986816:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940657.836839:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840035986816:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 77us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940657.836848:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 199 00000100:00100000:1.0:1788940657.836881:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035986944 00000100:00100000:1.0:1788940657.836885:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035986944 00000100:00100000:1.0:1788940657.836924:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 44 00000100:00100000:1.0:1788940657.836932:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035986944:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940657.836963:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035986944:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940657.836970:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 44 00000100:00080000:1.0:1788940657.837097:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940657.844401:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940657.844434:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940657.844490:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035987072 00000100:00100000:0.0:1788940657.844499:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035987072 00000100:00100000:0.0:1788940657.844559:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035987200 00000100:00100000:0.0:1788940657.844562:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035987200 00000100:00100000:0.0:1788940657.844583:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:0.0:1788940657.844592:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2357:x1875840035987072:12345-192.168.202.17@tcp:9:kworker.0 00000020:00000080:0.0:1788940657.844623:0:6674:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2c6b 00000100:00080000:0.0:1788940657.844632:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8f413a727800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788940657.844681:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788940657.845032:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+2:2357:x1875840035987072:12345-192.168.202.17@tcp:9:kworker.0 Request processed in 439us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940657.845046:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:0.0:1788940657.845062:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:0.0:1788940657.845069:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2357:x1875840035987200:12345-192.168.202.17@tcp:9:kworker.0 00000020:00000080:0.0:1788940657.845083:0:6674:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2c72 00000100:00080000:0.0:1788940657.845089:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8f413a726800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788940657.845110:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788940657.845311:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+2:2357:x1875840035987200:12345-192.168.202.17@tcp:9:kworker.0 Request processed in 241us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940657.845318:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 11 00010000:00010000:0.0:1788940657.845401:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940657.845406:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788940657.845937:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940657.845941:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788940658.250779:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788940658.765956:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000020:00000080:0.0:1788940658.765971:0:6697:0:(genops.c:885:class_export_put()) final put ffff8f413a726000/9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000020:00000080:3.0:1788940658.766021:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413a726000/9fbe6afa-4201-4af1-bbe2-c715064eeb39 for lustre-OST0000 00000020:00000080:3.0:1788940658.766088:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f413a727800 for lustre-OST0000 00010000:00010000:2.0:1788940659.273012:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940659.720742:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068525312:0@lo:400:kworker.0 00000100:00100000:2.0:1788940659.720967:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068525184:0@lo:400:kworker.0 00000100:00100000:1.0:1788940659.720967:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068525056:0@lo:400:kworker.0 00000100:00100000:1.0:1788940659.721014:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940659.721067:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068525568:0@lo:400:kworker.0 00000100:00100000:2.0:1788940659.721069:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068525056 00000100:00100000:2.0:1788940659.721076:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068525056 00000100:00100000:3.0:1788940659.721118:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940659.721127:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788940659.721136:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068525056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940659.721153:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940659.721159:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068525440:0@lo:400:kworker.0 00000100:00100000:3.0:1788940659.721183:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940659.721184:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068525056:12345-0@lo:400:kworker.0 Request processed in 49us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940659.721218:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788940659.721235:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068525312 00000100:00100000:3.0:1788940659.721239:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068525312 00000100:00080000:2.0:1788940659.721266:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940659.721280:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788940659.721287:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068525312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940659.721342:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068525312:12345-0@lo:400:kworker.0 Request processed in 47us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940659.721349:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788940659.721369:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068525440 00000100:00100000:3.0:1788940659.721372:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068525440 00000100:00100000:2.0:1788940659.721386:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068525312:0@lo:400:kworker.0 00000100:00100000:3.0:1788940659.721399:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788940659.721405:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068525440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940659.721461:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068525440:12345-0@lo:400:kworker.0 Request processed in 56us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940659.721468:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788940659.721494:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940659.721503:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940659.721524:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068525696:0@lo:400:kworker.0 00000100:00100000:3.0:1788940659.721546:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940659.721572:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068525184 00000100:00100000:3.0:1788940659.721576:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068525184 00000100:00100000:3.0:1788940659.721598:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788940659.721604:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068525184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940659.721636:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068525184:12345-0@lo:400:kworker.0 Request processed in 32us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940659.721643:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788940659.721657:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068525696 00000100:00100000:3.0:1788940659.721660:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068525696 00000100:00100000:3.0:1788940659.721684:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788940659.721689:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068525696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940659.721715:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068525696:12345-0@lo:400:kworker.0 Request processed in 26us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940659.721721:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788940659.721737:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940659.721752:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f873480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068525184:0@lo:400:kworker.0 00010000:00080000:3.0:1788940659.721762:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413f870e00 x1875840068525696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940659.721772:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068525696:0@lo:400:kworker.0 00000100:00100000:3.0:1788940659.721787:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940659.721807:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068525056:0@lo:400:kworker.0 00000100:00100000:3.0:1788940659.721819:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068525568 00000100:00100000:3.0:1788940659.721829:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068525568 00010000:00080000:2.0:1788940659.722008:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413f873b80 x1875840068525440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940659.722018:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f873b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068525440:0@lo:400:kworker.0 00000100:00080000:2.0:1788940659.722334:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940659.728007:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788940659.728028:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068525568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940659.728148:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068525568:12345-0@lo:400:kworker.0 Request processed in 129us (6359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940659.728156:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788940659.728225:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068525568:0@lo:400:kworker.0 00000100:00100000:3.0:1788940660.232450:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068525824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940660.232519:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940660.232622:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068525824 00000100:00100000:0.0:1788940660.232631:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068525824 00000100:00100000:0.0:1788940660.232681:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788940660.232692:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068525824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940660.232724:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940660.236141:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068525824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3437us (3607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940660.236156:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788940660.238990:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f40025aea00 x1875840068525824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940660.239018:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068525824:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940660.299026:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940661.320532:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940661.771351:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068525952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940661.771439:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940661.771568:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068525952 00000100:00100000:0.0:1788940661.771576:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068525952 00000100:00100000:0.0:1788940661.771641:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788940661.771651:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068525952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940661.771686:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940661.771733:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068525952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940661.771741:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788940661.771765:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940661.771799:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4002583b80 x1875840068525952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940677 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940661.771818:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068525952:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788940662.150562:0:9043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg217-server.virtnet: executing yml_node 00000001:00100000:3.0:1788940662.306611:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000020:00000080:3.0:1788940662.306622:0:7633:0:(genops.c:885:class_export_put()) final put ffff8f413a722000/9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000020:00000080:0.0:1788940662.306702:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413a722000/9fbe6afa-4201-4af1-bbe2-c715064eeb39 for lustre-OST0001 00000020:00000080:0.0:1788940662.306998:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f413a726800 for lustre-OST0001 00010000:00010000:3.0:1788940662.344363:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940662.974968:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940662.975007:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940662.975046:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035987328 00000100:00100000:1.0:1788940662.975057:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035987328 00000100:00100000:1.0:1788940662.975113:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 201 00000100:00100000:1.0:1788940662.975124:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840035987328:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940662.975237:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840035987328:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 114us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940662.975245:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 201 00000100:00100000:1.0:1788940662.975284:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035987456 00000100:00100000:1.0:1788940662.975288:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035987456 00000100:00100000:1.0:1788940662.975328:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 48 00000100:00100000:1.0:1788940662.975335:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035987456:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940662.975368:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035987456:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 34us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940662.975374:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 48 00000100:00080000:1.0:1788940662.975517:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788940663.369957:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940664.395140:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940664.841016:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068526336:0@lo:400:kworker.0 00000100:00100000:2.0:1788940664.841104:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940664.841184:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940664.841215:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068526464:0@lo:400:kworker.0 00000100:00100000:2.0:1788940664.841240:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940664.841339:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068526208:0@lo:400:kworker.0 00000100:00100000:0.0:1788940664.841378:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940664.841415:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068526720:0@lo:400:kworker.0 00000100:00100000:0.0:1788940664.841436:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940664.841464:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788940664.841470:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068526080:0@lo:400:kworker.0 00000100:00100000:0.0:1788940664.841498:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940664.841518:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068526592:0@lo:400:kworker.0 00000100:00100000:0.0:1788940664.841539:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940664.841569:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068526464 00000100:00100000:0.0:1788940664.841576:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068526464 00000100:00100000:0.0:1788940664.841636:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068526720 00000100:00100000:0.0:1788940664.841640:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068526720 00000100:00100000:0.0:1788940664.841665:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788940664.841691:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068526464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940664.841751:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068526464:12345-0@lo:400:kworker.0 Request processed in 63us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940664.841759:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788940664.841776:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940664.841782:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068526720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940664.841813:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068526720:12345-0@lo:400:kworker.0 Request processed in 31us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940664.841820:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788940664.841855:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f40025ad500 x1875840068526720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940664.841869:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068526720:0@lo:400:kworker.0 00010000:00080000:0.0:1788940664.841898:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f40025ace00 x1875840068526464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940664.841906:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068526464:0@lo:400:kworker.0 00000100:00100000:2.0:1788940664.842177:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068526336 00000100:00100000:2.0:1788940664.842182:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068526336 00000100:00100000:2.0:1788940664.842238:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068526208 00000100:00100000:2.0:1788940664.842241:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068526208 00000100:00100000:2.0:1788940664.842254:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068526592 00000100:00100000:2.0:1788940664.842257:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068526592 00000100:00100000:2.0:1788940664.842271:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788940664.842278:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068526336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940664.842318:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068526336:12345-0@lo:400:kworker.0 Request processed in 41us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940664.842324:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788940664.842347:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788940664.842359:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068526208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940664.842412:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068526208:12345-0@lo:400:kworker.0 Request processed in 60us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940664.842421:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788940664.842432:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788940664.842437:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068526592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940664.842462:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068526592:12345-0@lo:400:kworker.0 Request processed in 25us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940664.842467:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788940664.842496:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068526592:0@lo:400:kworker.0 00000100:00100000:2.0:1788940664.842504:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068526208:0@lo:400:kworker.0 00000100:00100000:0.0:1788940664.842778:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068526336:0@lo:400:kworker.0 00000100:00100000:1.0:1788940664.842855:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068526080 00000100:00100000:1.0:1788940664.842860:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068526080 00000100:00100000:1.0:1788940664.842896:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788940664.842903:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068526080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940664.842955:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068526080:12345-0@lo:400:kworker.0 Request processed in 53us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940664.842970:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:1.0:1788940664.843005:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940664.843010:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940664.843012:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940664.844246:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068526080:0@lo:400:kworker.0 00000100:00100000:2.0:1788940665.353417:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940665.353444:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068526848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940665.353529:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940665.353790:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068526848 00000100:00100000:1.0:1788940665.353799:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068526848 00000100:00100000:1.0:1788940665.353856:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788940665.353865:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068526848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940665.353899:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940665.353953:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068526848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940665.353961:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788940665.354047:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f40025aca80 x1875840068526848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940665.354065:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068526848:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940665.417027:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940666.448965:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940666.888437:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940666.888891:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068526976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940666.889065:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940666.889224:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068526976 00000100:00100000:3.0:1788940666.889233:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068526976 00000100:00100000:3.0:1788940666.889298:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788940666.889308:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068526976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940666.889363:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940666.889420:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068526976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940666.889427:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788940666.889501:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940666.889611:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4002581500 x1875840068526976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940682 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940666.889632:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068526976:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788940667.464388:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940668.084618:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940668.084664:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940668.084699:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035987712 00000100:00100000:0.0:1788940668.084709:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035987712 00000100:00100000:0.0:1788940668.084777:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 52 00000100:00100000:0.0:1788940668.084787:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2360:x1875840035987712:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940668.084854:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2360:x1875840035987712:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940668.084861:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 52 00000100:00080000:0.0:1788940668.084882:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940668.085581:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035987584 00000100:00100000:1.0:1788940668.085589:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035987584 00000100:00100000:1.0:1788940668.085632:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 203 00000100:00100000:1.0:1788940668.085640:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:2360:x1875840035987584:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940668.085675:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:2360:x1875840035987584:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 36us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940668.085682:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 203 00010000:00010000:0.0:1788940668.488412:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788940668.597380:0:9236:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.40 00010000:00010000:3.0:1788940669.512324:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940669.962962:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940669.962990:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068527104:0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.963070:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940669.963134:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068527104 00000100:00100000:1.0:1788940669.963142:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068527104 00000100:00100000:1.0:1788940669.963206:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788940669.963216:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068527104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.963279:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068527104:12345-0@lo:400:kworker.0 Request processed in 65us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940669.963287:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788940669.963335:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068527104:0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.963389:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068527232:0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.963414:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940669.963440:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068527232 00000100:00100000:1.0:1788940669.963444:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068527232 00000100:00100000:1.0:1788940669.963466:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940669.963472:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068527232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.963507:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068527232:12345-0@lo:400:kworker.0 Request processed in 35us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940669.963514:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940669.963542:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068527232:0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.963577:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068527360:0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.963602:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940669.963632:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068527360 00000100:00100000:1.0:1788940669.963635:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068527360 00000100:00100000:1.0:1788940669.963667:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788940669.963673:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068527360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.963720:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068527360:12345-0@lo:400:kworker.0 Request processed in 47us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940669.963727:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788940669.963743:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940669.963763:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068527360:0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.963803:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068527488:0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.963832:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940669.963862:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068527488 00000100:00100000:1.0:1788940669.963866:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068527488 00000100:00100000:1.0:1788940669.963900:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788940669.963906:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068527488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.963954:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068527488:12345-0@lo:400:kworker.0 Request processed in 48us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940669.963960:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788940669.963974:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940669.963993:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f40025ac000 x1875840068527488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940669.964004:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068527488:0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.964028:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940669.964033:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068527616:0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.964056:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940669.964077:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068527616 00000100:00100000:1.0:1788940669.964080:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068527616 00000100:00100000:1.0:1788940669.964106:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788940669.964111:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068527616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.964142:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068527616:12345-0@lo:400:kworker.0 Request processed in 31us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940669.964149:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788940669.964161:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940669.964178:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068527616:0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.964232:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068527744:0@lo:400:kworker.0 00000100:00100000:1.0:1788940669.964264:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940669.965241:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068527744 00000100:00100000:0.0:1788940669.965250:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068527744 00000100:00100000:0.0:1788940669.965302:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788940669.965309:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068527744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940669.965378:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068527744:12345-0@lo:400:kworker.0 Request processed in 69us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940669.965385:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788940669.965835:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788940669.965867:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f40025ac000 x1875840068527744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940669.965880:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068527744:0@lo:400:kworker.0 00000100:00100000:2.0:1788940670.473504:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068527872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940670.473597:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940670.474049:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068527872 00000100:00100000:1.0:1788940670.474060:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068527872 00000100:00100000:1.0:1788940670.474115:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940670.474124:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068527872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940670.474160:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940670.474235:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068527872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940670.474242:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788940670.475680:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f40025ac000 x1875840068527872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940670.475708:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068527872:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940670.541493:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940671.561313:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788940671.587111:0:9335:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.40 00000100:00100000:2.0:1788940672.010086:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068528000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940672.010202:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940672.010298:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068528000 00000100:00100000:2.0:1788940672.010308:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068528000 00000100:00100000:2.0:1788940672.010390:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940672.010400:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068528000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940672.010466:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940672.010518:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068528000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940672.010525:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788940672.010549:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940672.010585:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f411129b800 x1875840068528000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940672.010607:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068528000:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788940672.589706:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940673.194483:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940673.194617:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940673.194644:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035987840 00000100:00100000:0.0:1788940673.194664:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035987840 00000100:00100000:0.0:1788940673.194752:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 205 00000100:00100000:0.0:1788940673.194765:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840035987840:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940673.194872:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840035987840:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 111us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940673.194902:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 205 00000100:00100000:2.0:1788940673.195094:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035987968 00000100:00100000:2.0:1788940673.195106:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035987968 00000100:00100000:2.0:1788940673.195164:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 56 00000100:00100000:2.0:1788940673.195172:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035987968:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940673.195261:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035987968:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 90us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940673.195268:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 56 00000100:00080000:3.0:1788940673.195709:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788940673.608534:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788940674.307498:0:9432:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.40 00010000:00010000:3.0:1788940674.632414:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940675.080496:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068528512:0@lo:400:kworker.0 00000100:00100000:2.0:1788940675.080611:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940675.080722:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940675.080732:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068528384:0@lo:400:kworker.0 00000100:00100000:0.0:1788940675.080741:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068528128:0@lo:400:kworker.0 00000100:00100000:2.0:1788940675.080805:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940675.080859:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940675.080907:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068528128 00000100:00100000:2.0:1788940675.080918:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068528128 00000100:00100000:2.0:1788940675.080984:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788940675.080995:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068528128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940675.081251:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068528256:0@lo:400:kworker.0 00000100:00100000:2.0:1788940675.081374:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068528128:12345-0@lo:400:kworker.0 Request processed in 380us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940675.081391:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788940675.081456:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068528384 00000100:00100000:2.0:1788940675.081461:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068528384 00000100:00100000:3.0:1788940675.081507:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068528512 00000100:00100000:3.0:1788940675.081518:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068528512 00000100:00100000:0.0:1788940675.084697:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068528128:0@lo:400:kworker.0 00000100:00100000:0.0:1788940675.085014:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068528640:0@lo:400:kworker.0 00000100:00100000:0.0:1788940675.085081:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940675.085167:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068528640 00000100:00100000:0.0:1788940675.085173:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068528640 00000100:00100000:2.0:1788940675.086482:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788940675.086503:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068528384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940675.086624:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068528384:12345-0@lo:400:kworker.0 Request processed in 128us (5819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940675.086989:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788940675.087073:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068528384:0@lo:400:kworker.0 00000100:00100000:3.0:1788940675.087330:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788940675.087356:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068528512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940675.087359:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940675.087408:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068528256 00000100:00100000:1.0:1788940675.087419:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068528256 00000100:00100000:1.0:1788940675.087474:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788940675.087487:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068528512:12345-0@lo:400:kworker.0 Request processed in 125us (6855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940675.087487:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068528256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940675.087504:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940675.087552:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068528256:12345-0@lo:400:kworker.0 Request processed in 67us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940675.087562:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1788940675.087578:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134690000 x1875840068528512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940675.087614:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068528512:0@lo:400:kworker.0 00000100:00100000:1.0:1788940675.087671:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068528256:0@lo:400:kworker.0 00000100:00100000:1.0:1788940675.087689:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068528768:0@lo:400:kworker.0 00000100:00100000:1.0:1788940675.087733:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940675.087806:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068528768 00000100:00100000:1.0:1788940675.087811:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068528768 00000100:00100000:1.0:1788940675.087855:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788940675.087863:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068528768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940675.087900:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068528768:12345-0@lo:400:kworker.0 Request processed in 38us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940675.087907:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788940675.087934:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134693b80 x1875840068528768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940675.087945:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068528768:0@lo:400:kworker.0 00000100:00080000:2.0:1788940675.090348:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940675.090502:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940675.090511:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940675.091089:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788940675.091107:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068528640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940675.091240:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068528640:12345-0@lo:400:kworker.0 Request processed in 138us (6159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940675.091249:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788940675.091353:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068528640:0@lo:400:kworker.0 00000100:00100000:3.0:1788940675.592909:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068528896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940675.593028:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940675.594683:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068528896 00000100:00100000:0.0:1788940675.594702:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068528896 00000100:00100000:0.0:1788940675.594790:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788940675.594801:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068528896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940675.594857:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940675.594957:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068528896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940675.594966:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788940675.596694:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4002583100 x1875840068528896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940675.596766:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068528896:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940675.659958:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788940676.091257:0:9480:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 9 03:57:53 EDT 2026 00010000:00010000:1.0:1788940676.681540:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940677.129387:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068529024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940677.129463:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940677.129582:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068529024 00000100:00100000:0.0:1788940677.129592:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068529024 00000100:00100000:0.0:1788940677.129670:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940677.129692:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068529024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940677.129725:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940677.129973:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068529024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 282us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940677.129981:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788940677.130022:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4002582d80 x1875840068529024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940677.130040:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068529024:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788940677.130950:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940677.704464:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940678.322948:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940678.323010:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940678.323140:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035988224 00000100:00100000:2.0:1788940678.323152:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035988224 00000100:00100000:2.0:1788940678.323255:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 60 00000100:00100000:2.0:1788940678.323266:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2361:x1875840035988224:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940678.323357:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2361:x1875840035988224:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 92us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940678.323365:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 60 00000100:00080000:1.0:1788940678.323789:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940678.324727:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035988096 00000100:00100000:3.0:1788940678.324741:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035988096 00000100:00100000:3.0:1788940678.324804:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 207 00000100:00100000:3.0:1788940678.324812:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:2361:x1875840035988096:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940678.324875:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:2361:x1875840035988096:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 64us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940678.324882:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 207 00010000:00010000:0.0:1788940678.731689:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940679.752597:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940680.204022:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068529280:0@lo:400:kworker.0 00000100:00100000:2.0:1788940680.204106:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940680.204170:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068529792:0@lo:400:kworker.0 00000100:00100000:2.0:1788940680.204234:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940680.204277:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788940680.204284:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068529152:0@lo:400:kworker.0 00000100:00100000:2.0:1788940680.204322:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940680.204340:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068529664:0@lo:400:kworker.0 00000100:00100000:2.0:1788940680.204359:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940680.204433:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068529280 00000100:00100000:1.0:1788940680.204441:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068529280 00000100:00100000:1.0:1788940680.204488:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068529664 00000100:00100000:1.0:1788940680.204491:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068529664 00000100:00100000:1.0:1788940680.204521:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788940680.204530:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068529280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940680.204581:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068529280:12345-0@lo:400:kworker.0 Request processed in 52us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940680.204590:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788940680.204623:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788940680.204630:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068529664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940680.204658:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068529664:12345-0@lo:400:kworker.0 Request processed in 28us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940680.204664:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788940680.204682:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068529152 00000100:00100000:1.0:1788940680.204685:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068529152 00000100:00100000:1.0:1788940680.204706:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788940680.204713:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068529152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940680.204741:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068529152:12345-0@lo:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940680.204746:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:1.0:1788940680.204768:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940680.204904:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068529152:0@lo:400:kworker.0 00000100:00100000:2.0:1788940680.204917:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068529664:0@lo:400:kworker.0 00000100:00100000:2.0:1788940680.204925:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068529280:0@lo:400:kworker.0 00000100:00100000:3.0:1788940680.205129:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068529792 00000100:00100000:3.0:1788940680.205135:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068529792 00000100:00100000:3.0:1788940680.205182:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788940680.205207:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068529792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940680.205248:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068529792:12345-0@lo:400:kworker.0 Request processed in 60us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940680.205266:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788940680.205309:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f40025ace00 x1875840068529792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940680.205320:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068529792:0@lo:400:kworker.0 00000100:00080000:1.0:1788940680.205507:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940680.205804:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068529408:0@lo:400:kworker.0 00000100:00100000:0.0:1788940680.205849:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940680.205885:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940680.205893:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068529536:0@lo:400:kworker.0 00000100:00100000:0.0:1788940680.205918:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940680.205966:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068529408 00000100:00100000:0.0:1788940680.205971:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068529408 00000100:00100000:0.0:1788940680.206014:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788940680.206021:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068529408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940680.206064:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068529408:12345-0@lo:400:kworker.0 Request processed in 44us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940680.206072:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788940680.206088:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940680.206109:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068529408:0@lo:400:kworker.0 00000100:00100000:2.0:1788940680.206214:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068529536 00000100:00100000:2.0:1788940680.206220:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068529536 00000100:00100000:2.0:1788940680.206264:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788940680.206273:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068529536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940680.206327:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068529536:12345-0@lo:400:kworker.0 Request processed in 56us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940680.206333:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788940680.206362:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f40025afb80 x1875840068529536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940680.206372:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068529536:0@lo:400:kworker.0 00000100:00080000:0.0:1788940680.207309:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940680.716066:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940680.716087:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068529920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940680.716177:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940680.716302:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068529920 00000100:00100000:0.0:1788940680.716310:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068529920 00000100:00100000:0.0:1788940680.716360:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788940680.716369:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068529920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940680.716404:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940680.716449:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068529920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940680.716456:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788940680.718626:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4002581880 x1875840068529920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940680.718655:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068529920:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940680.777858:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940681.801403:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940682.253554:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068530048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940682.254372:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940682.255499:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068530048 00000100:00100000:3.0:1788940682.255517:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068530048 00000100:00100000:3.0:1788940682.255629:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788940682.255642:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068530048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940682.255713:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940682.255802:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068530048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940682.255811:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788940682.256392:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4002581880 x1875840068530048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940682.256422:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068530048:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788940682.257261:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940682.831871:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940683.443944:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940683.443999:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940683.444028:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035988352 00000100:00100000:0.0:1788940683.444038:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035988352 00000100:00100000:0.0:1788940683.444088:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 209 00000100:00100000:0.0:1788940683.444098:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:2361:x1875840035988352:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940683.444169:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+10:2361:x1875840035988352:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 72us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940683.444176:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 209 00000100:00100000:1.0:1788940683.444400:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035988480 00000100:00100000:1.0:1788940683.444405:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035988480 00000100:00100000:1.0:1788940683.444454:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 64 00000100:00100000:1.0:1788940683.444461:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2361:x1875840035988480:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940683.444501:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2361:x1875840035988480:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 41us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940683.444509:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 64 00000100:00080000:0.0:1788940683.445915:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788940683.851080:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940684.872699:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940685.321456:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068530304:0@lo:400:kworker.0 00000100:00100000:2.0:1788940685.321526:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940685.321578:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068530816:0@lo:400:kworker.0 00000100:00100000:2.0:1788940685.321605:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940685.321647:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788940685.321653:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068530176:0@lo:400:kworker.0 00000100:00100000:2.0:1788940685.321683:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940685.321704:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068530688:0@lo:400:kworker.0 00000100:00100000:2.0:1788940685.321725:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940685.321751:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068530560:0@lo:400:kworker.0 00000100:00100000:2.0:1788940685.321774:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940685.321793:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940685.321799:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068530432:0@lo:400:kworker.0 00000100:00100000:2.0:1788940685.321820:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940685.321847:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068530304 00000100:00100000:2.0:1788940685.321854:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068530304 00000100:00100000:2.0:1788940685.321894:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068530688 00000100:00100000:2.0:1788940685.321897:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068530688 00000100:00100000:2.0:1788940685.321916:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068530432 00000100:00100000:2.0:1788940685.321918:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068530432 00000100:00100000:2.0:1788940685.321933:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788940685.321941:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068530304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940685.321993:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068530304:12345-0@lo:400:kworker.0 Request processed in 52us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940685.322000:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788940685.322017:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788940685.322022:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068530688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940685.322047:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068530688:12345-0@lo:400:kworker.0 Request processed in 25us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940685.322053:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788940685.322063:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788940685.322075:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068530432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940685.322104:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068530432:12345-0@lo:400:kworker.0 Request processed in 31us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940685.322110:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788940685.322128:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068530816 00000100:00100000:2.0:1788940685.322132:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068530816 00000100:00080000:0.0:1788940685.323573:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940685.324374:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068530560 00000100:00100000:2.0:1788940685.324386:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068530560 00000100:00100000:2.0:1788940685.324419:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788940685.324427:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068530816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940685.324509:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068530816:12345-0@lo:400:kworker.0 Request processed in 82us (2903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940685.324516:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788940685.324533:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788940685.324539:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068530560:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788940685.324697:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940685.324701:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940685.324964:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068530560:12345-0@lo:400:kworker.0 Request processed in 425us (3188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940685.324971:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788940685.324993:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068530176 00000100:00100000:2.0:1788940685.324997:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068530176 00000100:00100000:2.0:1788940685.325031:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788940685.325037:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068530176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940685.325068:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068530176:12345-0@lo:400:kworker.0 Request processed in 31us (3384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940685.325074:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788940685.325129:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068530176:0@lo:400:kworker.0 00000100:00100000:2.0:1788940685.325394:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068530688:0@lo:400:kworker.0 00000100:00100000:2.0:1788940685.325406:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068530304:0@lo:400:kworker.0 00010000:00080000:2.0:1788940685.325419:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a042d80 x1875840068530816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940685.325429:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068530816:0@lo:400:kworker.0 00000100:00100000:2.0:1788940685.325468:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068530432:0@lo:400:kworker.0 00010000:00080000:2.0:1788940685.325483:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a040000 x1875840068530560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940685.325492:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068530560:0@lo:400:kworker.0 00000100:00100000:3.0:1788940685.832519:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940685.832543:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068530944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940685.832639:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940685.833087:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068530944 00000100:00100000:0.0:1788940685.833098:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068530944 00000100:00100000:0.0:1788940685.833154:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788940685.833164:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068530944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940685.833227:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940685.833359:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068530944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 196us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940685.833367:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788940685.833998:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4002583100 x1875840068530944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940685.834019:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068530944:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940685.897376:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940686.922157:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940687.373657:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940687.373680:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068531072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940687.373750:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940687.373918:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068531072 00000100:00100000:0.0:1788940687.373927:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068531072 00000100:00100000:0.0:1788940687.373997:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788940687.374007:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940687.374008:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068531072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940687.374050:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940687.374110:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068531072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940687.374117:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788940687.374172:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a040000 x1875840068531072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940687.374213:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068531072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788940687.950654:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940688.566757:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940688.566811:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940688.566892:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035988608 00000100:00100000:0.0:1788940688.566902:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035988608 00000100:00100000:0.0:1788940688.566958:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 211 00000100:00100000:0.0:1788940688.566969:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840035988608:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940688.567044:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840035988608:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 68us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940688.567052:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 211 00000100:00100000:0.0:1788940688.569420:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035988736 00000100:00100000:0.0:1788940688.569444:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035988736 00000100:00100000:0.0:1788940688.571510:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 68 00000100:00100000:0.0:1788940688.571536:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035988736:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940688.571619:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035988736:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 98us (4806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940688.571627:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 68 00000100:00080000:1.0:1788940688.573853:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788940688.968903:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940689.996357:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940690.441600:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068531456:0@lo:400:kworker.0 00000100:00100000:3.0:1788940690.441700:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940690.441764:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940690.441771:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068531584:0@lo:400:kworker.0 00000100:00100000:3.0:1788940690.441798:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940690.441893:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068531328:0@lo:400:kworker.0 00000100:00100000:0.0:1788940690.441924:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940690.441949:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068531840:0@lo:400:kworker.0 00000100:00100000:0.0:1788940690.441971:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940690.441992:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788940690.441997:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068531200:0@lo:400:kworker.0 00000100:00100000:0.0:1788940690.442024:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940690.442044:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068531712:0@lo:400:kworker.0 00000100:00100000:0.0:1788940690.442063:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940690.442090:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068531200 00000100:00100000:0.0:1788940690.442098:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068531200 00000100:00100000:0.0:1788940690.442141:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788940690.442150:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068531200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940690.442242:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068531200:12345-0@lo:400:kworker.0 Request processed in 92us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940690.442250:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788940690.442282:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068531456 00000100:00100000:0.0:1788940690.442286:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068531456 00000100:00100000:0.0:1788940690.442315:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068531328 00000100:00100000:0.0:1788940690.442318:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068531328 00000100:00100000:0.0:1788940690.442336:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068531712 00000100:00100000:0.0:1788940690.442338:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068531712 00000100:00100000:0.0:1788940690.442350:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788940690.442355:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068531456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940690.442386:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068531456:12345-0@lo:400:kworker.0 Request processed in 31us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940690.442391:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788940690.442401:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788940690.442406:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068531328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940690.442426:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068531328:12345-0@lo:400:kworker.0 Request processed in 20us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940690.442431:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788940690.442439:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788940690.442444:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068531712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940690.442464:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068531712:12345-0@lo:400:kworker.0 Request processed in 20us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940690.442469:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788940690.442524:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068531200:0@lo:400:kworker.0 00000100:00100000:0.0:1788940690.442537:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068531712:0@lo:400:kworker.0 00000100:00100000:0.0:1788940690.442546:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068531328:0@lo:400:kworker.0 00000100:00100000:2.0:1788940690.442765:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068531584 00000100:00100000:2.0:1788940690.442770:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068531584 00000100:00100000:2.0:1788940690.442804:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068531840 00000100:00100000:2.0:1788940690.442807:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068531840 00000100:00100000:2.0:1788940690.442826:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788940690.442832:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068531584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940690.442884:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068531584:12345-0@lo:400:kworker.0 Request processed in 52us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940690.442899:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788940690.442912:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788940690.442917:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068531840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940690.442950:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068531840:12345-0@lo:400:kworker.0 Request processed in 33us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940690.442956:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788940690.442988:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413f871c00 x1875840068531840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940690.443000:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068531840:0@lo:400:kworker.0 00000100:00080000:3.0:1788940690.443065:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940690.443069:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940690.443071:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788940690.443099:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413f870000 x1875840068531584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940690.443108:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068531584:0@lo:400:kworker.0 00000100:00100000:3.0:1788940690.443118:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068531456:0@lo:400:kworker.0 00000100:00100000:1.0:1788940690.957710:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940690.957757:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068531968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940690.957864:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940690.958216:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068531968 00000100:00100000:0.0:1788940690.958227:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068531968 00000100:00100000:0.0:1788940690.958299:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788940690.958310:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068531968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940690.958362:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940690.958430:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068531968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940690.958438:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788940690.959329:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134693b80 x1875840068531968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940690.959351:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068531968:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940691.021971:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788940691.708833:0:10110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 03:58:09 (1788940689) === 00010000:00010000:3.0:1788940692.040437:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940692.126441:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940692.126855:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035988864 00000100:00100000:2.0:1788940692.126867:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035988864 00000100:00100000:2.0:1788940692.126929:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 213 00000100:00100000:2.0:1788940692.126939:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+10:8137:x1875840035988864:12345-192.168.202.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788940692.126956:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940692.126973:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa2d36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226350 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940692.127004:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa2d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226350 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940692.127017:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa2d36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226350 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940692.127027:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6000, rc 0) 00000100:00100000:2.0:1788940692.127099:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+11:8137:x1875840035988864:12345-192.168.202.17@tcp:101:mount.lustre.0 Request processed in 162us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940692.127123:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 213 00000100:00100000:0.0:1788940692.132525:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940692.132828:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035988992 00000100:00100000:2.0:1788940692.132840:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035988992 00000100:00100000:2.0:1788940692.132900:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 214 00000100:00100000:2.0:1788940692.132911:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+11:8137:x1875840035988992:12345-192.168.202.17@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788940692.133299:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+11:8137:x1875840035988992:12345-192.168.202.17@tcp:501:mount.lustre.0 Request processed in 388us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940692.133307:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 214 00000100:00100000:1.0:1788940692.148714:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940692.148823:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035989120 00000100:00100000:0.0:1788940692.148834:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035989120 00000100:00100000:0.0:1788940692.148900:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 215 00000100:00100000:0.0:1788940692.148910:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+11:8137:x1875840035989120:12345-192.168.202.17@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788940692.149167:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+11:8137:x1875840035989120:12345-192.168.202.17@tcp:503:mount.lustre.0 Request processed in 256us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940692.149176:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 215 00000100:00100000:1.0:1788940692.153265:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940692.153374:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035989248 00000100:00100000:2.0:1788940692.153385:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035989248 00000100:00100000:2.0:1788940692.153448:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 216 00000100:00100000:2.0:1788940692.153458:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+11:8141:x1875840035989248:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940692.153970:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+11:8141:x1875840035989248:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 512us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940692.153979:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 216 00000100:00100000:3.0:1788940692.180039:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940692.180167:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035989376 00000100:00100000:2.0:1788940692.180179:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035989376 00000100:00100000:2.0:1788940692.180266:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 217 00000100:00100000:2.0:1788940692.180277:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+11:8141:x1875840035989376:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940692.180593:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+11:8141:x1875840035989376:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 307us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940692.180602:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 217 00000100:00100000:1.0:1788940692.192003:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940692.192390:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035989504 00000100:00100000:2.0:1788940692.192401:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035989504 00000100:00100000:2.0:1788940692.192477:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 218 00000100:00100000:2.0:1788940692.192488:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+11:8137:x1875840035989504:12345-192.168.202.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788940692.192505:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940692.192522:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6200/0xa1d8aa9164aa2d3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22637a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940692.192863:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6200/0xa1d8aa9164aa2d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22637a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940692.192938:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc6200/0xa1d8aa9164aa2d3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22637a expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940692.192949:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6200, rc 0) 00000100:00100000:2.0:1788940692.195825:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+12:8137:x1875840035989504:12345-192.168.202.17@tcp:101:mount.lustre.0 Request processed in 3327us (3820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940692.195838:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 218 00000100:00100000:1.0:1788940692.206775:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940692.209727:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035989632 00000100:00100000:0.0:1788940692.209743:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035989632 00000100:00100000:0.0:1788940692.209824:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 219 00000100:00100000:0.0:1788940692.209835:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+12:8137:x1875840035989632:12345-192.168.202.17@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788940692.209862:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788940692.209895:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788940692.209900:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788940692.209903:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788940692.209906:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788940692.213216:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+12:8137:x1875840035989632:12345-192.168.202.17@tcp:256:mount.lustre.0 Request processed in 3349us (6417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940692.213231:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 219 00000100:00100000:3.0:1788940692.217370:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940692.218796:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035989760 00000100:00100000:0.0:1788940692.218811:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035989760 00000100:00100000:0.0:1788940692.218866:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 220 00000100:00100000:0.0:1788940692.218938:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+12:8137:x1875840035989760:12345-192.168.202.17@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788940692.218967:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940692.218986:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4136234800/0xa1d8aa9164aa2d44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226381 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940692.219014:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4136234800/0xa1d8aa9164aa2d44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226381 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940692.219024:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4136234800/0xa1d8aa9164aa2d44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226381 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940692.219033:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234800, rc 0) 00000100:00100000:0.0:1788940692.219483:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:8137:x1875840035989760:12345-192.168.202.17@tcp:101:mount.lustre.0 Request processed in 547us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940692.219491:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 220 00000100:00100000:3.0:1788940692.222272:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940692.222482:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035989888 00000100:00100000:0.0:1788940692.222501:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035989888 00000100:00100000:0.0:1788940692.222570:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 221 00000100:00100000:0.0:1788940692.222579:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:8137:x1875840035989888:12345-192.168.202.17@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788940692.223809:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:8137:x1875840035989888:12345-192.168.202.17@tcp:501:mount.lustre.0 Request processed in 1225us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940692.223821:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 221 00000100:00100000:3.0:1788940692.228489:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940692.232230:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035990016 00000100:00100000:1.0:1788940692.232245:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035990016 00000100:00100000:1.0:1788940692.232313:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 222 00000100:00100000:1.0:1788940692.232331:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:8137:x1875840035990016:12345-192.168.202.17@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788940692.232777:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:8137:x1875840035990016:12345-192.168.202.17@tcp:503:mount.lustre.0 Request processed in 445us (4298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940692.232786:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 222 00000100:00100000:3.0:1788940692.236887:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940692.237235:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035990144 00000100:00100000:2.0:1788940692.237247:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035990144 00000100:00100000:2.0:1788940692.237296:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 223 00000100:00100000:2.0:1788940692.237306:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:8144:x1875840035990144:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940692.237574:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:8144:x1875840035990144:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 268us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940692.237851:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 223 00000100:00100000:2.0:1788940692.243507:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940692.244003:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035990272 00000100:00100000:1.0:1788940692.244015:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035990272 00000100:00100000:1.0:1788940692.244154:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 224 00000100:00100000:1.0:1788940692.244168:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:8144:x1875840035990272:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940692.244972:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:8144:x1875840035990272:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 804us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940692.244983:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 224 00000100:00100000:3.0:1788940692.259525:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940692.259661:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035990784 00000100:00100000:0.0:1788940692.259686:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035990784 00000100:00100000:0.0:1788940692.259789:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 72 00000100:00100000:0.0:1788940692.259801:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2360:x1875840035990784:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940692.259916:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2360:x1875840035990784:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 117us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940692.259945:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 72 00000100:00080000:3.0:1788940692.260488:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940692.261114:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940692.262291:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035990400 00000100:00100000:3.0:1788940692.262305:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035990400 00000100:00100000:3.0:1788940692.262370:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:3.0:1788940692.262379:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1875840035990400:12345-192.168.202.17@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788940692.262415:0:5835:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 6703b9d8-8e00-4d48-b07a-3d1d34afc200@192.168.202.17@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:3.0:1788940692.262478:0:5835:0:(genops.c:1384:class_connect()) connect: client 6703b9d8-8e00-4d48-b07a-3d1d34afc200, cookie 0xa1d8aa9164aa2d4b 00000004:00100000:3.0:1788940692.262530:0:5835:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788940692.265758:0:5835:0:(import.c:65:import_set_state_nolock()) ffff8f413f185800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940692.266035:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+6:2357:x1875840035990400:12345-192.168.202.17@tcp:38:mount.lustre.0 Request processed in 3649us (4919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940692.266073:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:3.0:1788940692.269289:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940692.269374:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940692.269472:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035990528 00000100:00100000:2.0:1788940692.269486:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035990528 00000100:00100000:2.0:1788940692.269565:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035990656 00000100:00100000:2.0:1788940692.269569:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035990656 00000100:00100000:2.0:1788940692.269591:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:2.0:1788940692.269602:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+7:0:x1875840035990528:12345-192.168.202.17@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788940692.269662:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788940692.269820:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00100000:0.0:1788940692.269832:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+7:8137:x1875840035990656:12345-192.168.202.17@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788940692.269861:0:7198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788940692.278390:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+7:0:x1875840035990528:12345-192.168.202.17@tcp:41:mount.lustre.0 Request processed in 8768us (9096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940692.278410:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:0.0:1788940692.278561:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+7:8137:x1875840035990656:12345-192.168.202.17@tcp:41:mount.lustre.0 Request processed in 8730us (9183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940692.278571:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00080000:2.0:1788940692.280333:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940692.281616:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940692.281739:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035990912 00000100:00100000:0.0:1788940692.281754:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035990912 00000100:00100000:0.0:1788940692.282112:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00100000:0.0:1788940692.282127:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+6:8137:x1875840035990912:12345-192.168.202.17@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788940692.282281:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+6:8137:x1875840035990912:12345-192.168.202.17@tcp:40:mount.lustre.0 Request processed in 158us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940692.282290:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00100000:3.0:1788940692.285318:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940692.285476:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035991296 00000100:00100000:1.0:1788940692.285491:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035991296 00000100:00100000:1.0:1788940692.285578:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 1 00000100:00100000:1.0:1788940692.285590:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+6:8137:x1875840035991296:12345-192.168.202.17@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788940692.285703:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788940692.285820:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+6:8137:x1875840035991296:12345-192.168.202.17@tcp:33:mount.lustre.0 Request processed in 232us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940692.285829:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 1 00000100:00100000:3.0:1788940692.287624:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940692.287696:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940692.287732:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035991040 00000100:00100000:3.0:1788940692.287744:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035991040 00000100:00100000:3.0:1788940692.287789:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035991168 00000100:00100000:3.0:1788940692.287792:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035991168 00000100:00100000:3.0:1788940692.287822:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00100000:3.0:1788940692.287831:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875840035991040:12345-192.168.202.17@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788940692.287877:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6703b9d8-8e00-4d48-b07a-3d1d34afc200@192.168.202.17@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:3.0:1788940692.287921:0:6673:0:(genops.c:1384:class_connect()) connect: client 6703b9d8-8e00-4d48-b07a-3d1d34afc200, cookie 0xa1d8aa9164aa2d52 00002000:00100000:3.0:1788940692.287936:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6703b9d8-8e00-4d48-b07a-3d1d34afc200/ffff8f413f181000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788940692.287968:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788940692.293743:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00100000:1.0:1788940692.293763:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875840035991168:12345-192.168.202.17@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788940692.293822:0:6671:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6703b9d8-8e00-4d48-b07a-3d1d34afc200@192.168.202.17@tcp t0 exp 0000000000000000 cur 333 last 0 00000020:00000080:1.0:1788940692.293876:0:6671:0:(genops.c:1384:class_connect()) connect: client 6703b9d8-8e00-4d48-b07a-3d1d34afc200, cookie 0xa1d8aa9164aa2d59 00002000:00100000:1.0:1788940692.293894:0:6671:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6703b9d8-8e00-4d48-b07a-3d1d34afc200/ffff8f4002192800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788940692.293908:0:6671:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788940692.294281:0:6671:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788940692.294331:0:6671:0:(import.c:65:import_set_state_nolock()) ffff8f4002191800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940692.294455:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+6:2357:x1875840035991168:12345-192.168.202.17@tcp:8:mount.lustre.0 Request processed in 692us (6756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940692.294465:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 13 00002000:00080000:3.0:1788940692.300277:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788940692.300327:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8f413f180800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940692.300451:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+6:2357:x1875840035991040:12345-192.168.202.17@tcp:8:mount.lustre.0 Request processed in 12617us (12836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940692.300491:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00100000:2.0:1788940692.490630:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940692.490674:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068532096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940692.490782:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940692.490837:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068532096 00000100:00100000:3.0:1788940692.490849:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068532096 00000100:00100000:3.0:1788940692.490923:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788940692.490934:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068532096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940692.490960:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940692.491022:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068532096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940692.491029:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788940692.491176:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940692.491224:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a042d80 x1875840068532096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940692.491244:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068532096:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788940692.569668:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6703b9d8-8e00-4d48-b07a-3d1d34afc200 00010000:00010000:2.0:1788940693.066936:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788940693.114113:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6703b9d8-8e00-4d48-b07a-3d1d34afc200 00010000:00010000:1.0:1788940694.095405:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788940694.587749:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6703b9d8-8e00-4d48-b07a-3d1d34afc200 00010000:00010000:2.0:1788940695.114580:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940695.561684:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068532352:0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.561766:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940695.561815:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f2d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068532864:0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.561851:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940695.561895:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788940695.561901:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068532224:0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.561929:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940695.561948:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068532736:0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.561969:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940695.561993:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068532480:0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.562012:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940695.562028:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940695.562032:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068532608:0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.562053:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940695.562082:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068532352 00000100:00100000:1.0:1788940695.562089:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068532352 00000100:00100000:1.0:1788940695.562140:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068532736 00000100:00100000:1.0:1788940695.562143:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068532736 00000100:00100000:1.0:1788940695.562163:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068532480 00000100:00100000:1.0:1788940695.562165:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068532480 00000100:00100000:1.0:1788940695.562181:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788940695.562210:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068532352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.562259:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068532352:12345-0@lo:400:kworker.0 Request processed in 50us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940695.562266:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788940695.562282:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940695.562287:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068532736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.562313:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068532736:12345-0@lo:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940695.562318:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940695.562338:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788940695.562343:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068532480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.562374:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068532480:12345-0@lo:400:kworker.0 Request processed in 30us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940695.562379:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788940695.562891:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068532864 00000100:00100000:1.0:1788940695.562896:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068532864 00000100:00100000:1.0:1788940695.562926:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068532608 00000100:00100000:1.0:1788940695.562930:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068532608 00000100:00100000:1.0:1788940695.562952:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940695.562959:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068532864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.562994:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068532864:12345-0@lo:400:kworker.0 Request processed in 35us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940695.563000:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940695.563011:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788940695.563016:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068532608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.563064:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068532608:12345-0@lo:400:kworker.0 Request processed in 48us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940695.563069:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788940695.563088:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068532224 00000100:00100000:1.0:1788940695.563091:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068532224 00000100:00100000:1.0:1788940695.563124:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788940695.563131:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068532224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.563160:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068532224:12345-0@lo:400:kworker.0 Request processed in 30us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940695.563166:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788940695.563236:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068532224:0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.563261:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068532736:0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.563271:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068532352:0@lo:400:kworker.0 00010000:00080000:1.0:1788940695.563283:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413f2d7800 x1875840068532864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940695.563293:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f2d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068532864:0@lo:400:kworker.0 00010000:00080000:1.0:1788940695.563335:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f40025aca80 x1875840068532608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940695.563344:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068532608:0@lo:400:kworker.0 00000100:00100000:1.0:1788940695.563353:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068532480:0@lo:400:kworker.0 00000100:00080000:3.0:1788940695.563457:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940695.563478:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940695.563481:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940696.072715:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068532992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940696.072800:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940696.072920:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068532992 00000100:00100000:3.0:1788940696.072930:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068532992 00000100:00100000:3.0:1788940696.072985:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788940696.072994:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068532992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940696.073038:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940696.073233:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068532992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 239us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940696.073241:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788940696.073512:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134691180 x1875840068532992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940696.073527:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068532992:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940696.140753:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940697.160409:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940697.608471:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940697.608495:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068533120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940697.608572:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940697.608804:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068533120 00000100:00100000:0.0:1788940697.608814:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068533120 00000100:00100000:0.0:1788940697.608888:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788940697.608898:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068533120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940697.608937:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940697.608990:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068533120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940697.608997:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788940697.609051:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a042d80 x1875840068533120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940697.609082:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068533120:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788940697.609210:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940697.775816:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940697.775896:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940697.775939:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940697.775971:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035991936 00000100:00100000:3.0:1788940697.775982:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035991936 00000100:00100000:3.0:1788940697.776045:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 42 00000100:00100000:3.0:1788940697.776055:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41086cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840035991936:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940697.776140:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41086cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840035991936:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940697.776148:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 42 00000100:00080000:0.0:1788940697.776474:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940697.776546:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035991680 00000100:00100000:1.0:1788940697.776546:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035991424 00000100:00100000:2.0:1788940697.776552:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035991680 00000100:00100000:1.0:1788940697.776552:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035991424 00000100:00100000:1.0:1788940697.776585:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 226 00000100:00100000:2.0:1788940697.776588:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 76 00000100:00100000:1.0:1788940697.776593:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840035991424:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940697.776594:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840035991680:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940697.776623:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840035991424:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 32us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940697.776630:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 226 00000100:00100000:2.0:1788940697.776634:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840035991680:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 41us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940697.776639:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 76 00000100:00080000:2.0:1788940697.776657:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940697.796292:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940697.796395:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035991552 00000100:00100000:2.0:1788940697.796407:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035991552 00000100:00100000:2.0:1788940697.796607:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 77 00000100:00100000:2.0:1788940697.796620:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2361:x1875840035991552:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940697.796698:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2361:x1875840035991552:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 82us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940697.796705:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 77 00000100:00080000:0.0:1788940697.796778:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940697.796853:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940697.797012:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035991808 00000100:00100000:2.0:1788940697.797017:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035991808 00000100:00100000:2.0:1788940697.797113:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 43 00000100:00100000:2.0:1788940697.797121:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2361:x1875840035991808:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940697.797162:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2361:x1875840035991808:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 42us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940697.797168:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 43 00000100:00080000:0.0:1788940697.806686:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788940698.192757:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940698.917126:0:10306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg217-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788940699.208571:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940700.234177:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940700.680361:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f2d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068533376:0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.680432:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940700.680478:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f2d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068533888:0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.680501:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940700.680548:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788940700.680554:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f2d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068533248:0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.680583:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940700.680604:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068533760:0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.680624:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940700.680648:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f2d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068533632:0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.680669:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940700.680684:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940700.680688:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f2d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068533504:0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.680707:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940700.680734:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068533248 00000100:00100000:1.0:1788940700.680743:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068533248 00000100:00100000:1.0:1788940700.680788:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788940700.680796:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068533248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.680844:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068533248:12345-0@lo:400:kworker.0 Request processed in 48us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940700.680851:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788940700.680882:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068533376 00000100:00100000:1.0:1788940700.680885:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068533376 00000100:00100000:1.0:1788940700.680906:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068533760 00000100:00100000:1.0:1788940700.680909:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068533760 00000100:00100000:1.0:1788940700.680928:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068533504 00000100:00100000:1.0:1788940700.680943:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068533504 00000100:00100000:1.0:1788940700.680961:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788940700.680966:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068533376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.680997:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068533376:12345-0@lo:400:kworker.0 Request processed in 30us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940700.681003:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788940700.681015:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788940700.681020:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068533760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.681042:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068533760:12345-0@lo:400:kworker.0 Request processed in 23us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940700.681048:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788940700.681059:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788940700.681080:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068533504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.681111:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068533504:12345-0@lo:400:kworker.0 Request processed in 47us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940700.681117:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788940700.681154:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f2d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068533504:0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.681180:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f2d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068533248:0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.681220:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068533760:0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.681230:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f2d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068533376:0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.681271:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068533888 00000100:00100000:1.0:1788940700.681275:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068533888 00000100:00100000:1.0:1788940700.681299:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068533632 00000100:00100000:1.0:1788940700.681302:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068533632 00000100:00100000:1.0:1788940700.681318:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788940700.681330:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068533888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.681363:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068533888:12345-0@lo:400:kworker.0 Request processed in 33us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940700.681369:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788940700.681380:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788940700.681385:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068533632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940700.681411:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068533632:12345-0@lo:400:kworker.0 Request processed in 26us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940700.681417:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788940700.681443:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413f2d5880 x1875840068533632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940700.681454:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f2d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068533632:0@lo:400:kworker.0 00010000:00080000:1.0:1788940700.681475:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413f2d5180 x1875840068533888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940700.681484:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f2d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068533888:0@lo:400:kworker.0 00000100:00080000:1.0:1788940700.681501:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940700.681505:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940700.681508:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940701.197816:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068534016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940701.197898:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940701.198103:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068534016 00000100:00100000:0.0:1788940701.198113:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068534016 00000100:00100000:0.0:1788940701.198167:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788940701.198177:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068534016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940701.198246:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940701.198320:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068534016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940701.198329:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788940701.198525:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134690000 x1875840068534016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940701.198543:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068534016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940701.256906:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940702.283874:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940702.728515:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940702.728540:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f2d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068534144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940702.728610:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940702.728674:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068534144 00000100:00100000:1.0:1788940702.728682:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068534144 00000100:00100000:1.0:1788940702.728738:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788940702.728747:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068534144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940702.728783:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940702.728831:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068534144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940702.728839:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1788940702.728859:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940702.728888:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413f2d5880 x1875840068534144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940702.728905:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f2d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068534144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940702.911946:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940702.912136:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940702.912169:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940702.912216:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940702.912241:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940702.912267:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035992576 00000100:00100000:1.0:1788940702.912277:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035992576 00000100:00100000:1.0:1788940702.912332:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035992448 00000100:00100000:1.0:1788940702.912336:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035992448 00000100:00100000:1.0:1788940702.912361:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 46 00000100:00100000:1.0:1788940702.912371:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840035992576:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940702.912656:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840035992576:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 285us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940702.912676:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 46 00000100:00100000:1.0:1788940702.912694:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 47 00000100:00100000:1.0:1788940702.912700:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840035992448:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940702.912728:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840035992448:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 28us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940702.912734:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 47 00000100:00100000:1.0:1788940702.912753:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035992320 00000100:00100000:1.0:1788940702.912757:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035992320 00000100:00100000:1.0:1788940702.912782:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035992192 00000100:00100000:1.0:1788940702.912785:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035992192 00000100:00100000:1.0:1788940702.912802:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 81 00000100:00100000:1.0:1788940702.912809:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840035992320:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940702.912836:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840035992320:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 28us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940702.912843:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 81 00000100:00100000:1.0:1788940702.912854:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 82 00000100:00100000:1.0:1788940702.912861:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035992192:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940702.912885:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035992192:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 25us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940702.912891:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 82 00000100:00080000:1.0:1788940702.912909:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940702.912913:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940702.912915:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940702.914638:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035992064 00000100:00100000:2.0:1788940702.914651:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035992064 00000100:00100000:2.0:1788940702.914737:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 228 00000100:00100000:2.0:1788940702.914752:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:2359:x1875840035992064:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940702.914824:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:2359:x1875840035992064:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 79us (2887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940702.914846:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 228 00010000:00010000:2.0:1788940703.304314:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940704.328758:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940705.354411:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940705.800546:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068534656:0@lo:400:kworker.0 00000100:00100000:3.0:1788940705.800565:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068534272:0@lo:400:kworker.0 00000100:00100000:3.0:1788940705.800617:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940705.800617:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940705.800674:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068534784:0@lo:400:kworker.0 00000100:00100000:0.0:1788940705.800737:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068534528:0@lo:400:kworker.0 00000100:00100000:1.0:1788940705.800788:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068534400:0@lo:400:kworker.0 00000100:00100000:2.0:1788940705.800882:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068534656 00000100:00100000:2.0:1788940705.800891:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068534656 00000100:00100000:2.0:1788940705.800951:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940705.800961:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068534656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940705.801012:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068534656:12345-0@lo:400:kworker.0 Request processed in 53us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940705.801031:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788940705.801050:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940705.801073:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a042a00 x1875840068534656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940705.801089:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068534656:0@lo:400:kworker.0 00000100:00100000:2.0:1788940705.801136:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068534272 00000100:00100000:2.0:1788940705.801139:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068534272 00000100:00100000:2.0:1788940705.801165:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788940705.801171:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068534272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940705.801236:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068534272:12345-0@lo:400:kworker.0 Request processed in 64us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940705.801242:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788940705.804969:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940705.809552:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068534528 00000100:00100000:2.0:1788940705.809574:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068534528 00000100:00100000:2.0:1788940705.809672:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788940705.809687:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068534528:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788940705.809754:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940705.809806:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068534528:12345-0@lo:400:kworker.0 Request processed in 124us (4845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940705.809813:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788940705.809831:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068534528:0@lo:400:kworker.0 00000100:00100000:2.0:1788940705.811281:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940705.811351:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068534272:0@lo:400:kworker.0 00000100:00100000:0.0:1788940705.811430:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068534784 00000100:00100000:0.0:1788940705.811445:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068534784 00000100:00100000:0.0:1788940705.811509:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788940705.811519:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068534784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940705.811909:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068534784:12345-0@lo:400:kworker.0 Request processed in 389us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940705.811917:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788940705.812041:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940705.812066:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068534784:0@lo:400:kworker.0 00000100:00100000:1.0:1788940705.813221:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940705.813267:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068534912:0@lo:400:kworker.0 00000100:00100000:1.0:1788940705.813304:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940705.813414:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068534400 00000100:00100000:2.0:1788940705.813422:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068534400 00000100:00100000:2.0:1788940705.813480:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788940705.813489:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068534400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940705.813555:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068534400:12345-0@lo:400:kworker.0 Request processed in 60us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940705.813562:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788940705.813969:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068534400:0@lo:400:kworker.0 00000100:00100000:3.0:1788940705.817235:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068534912 00000100:00100000:3.0:1788940705.817252:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068534912 00000100:00100000:3.0:1788940705.817341:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788940705.817352:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068534912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940705.817463:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068534912:12345-0@lo:400:kworker.0 Request processed in 113us (4157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940705.817471:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788940705.819748:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a041880 x1875840068534912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940705.819791:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068534912:0@lo:400:kworker.0 00000100:00080000:2.0:1788940705.819891:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940706.318485:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940706.318513:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068535040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940706.318590:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940706.320023:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068535040 00000100:00100000:0.0:1788940706.320037:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068535040 00000100:00100000:0.0:1788940706.320109:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788940706.320120:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068535040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940706.320160:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940706.320279:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068535040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940706.320287:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788940706.320536:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134692d80 x1875840068535040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940706.320557:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068535040:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940706.380165:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940707.400486:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940707.863968:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068535168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940707.864054:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940707.864968:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068535168 00000100:00100000:0.0:1788940707.864980:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068535168 00000100:00080000:2.0:1788940707.866292:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940707.866582:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788940707.866599:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068535168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940707.866641:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940707.866724:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068535168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (2670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940707.866732:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788940707.868008:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a043800 x1875840068535168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940707.868040:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068535168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940708.011155:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940708.011217:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940708.011249:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940708.011270:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940708.011541:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035992832 00000100:00100000:1.0:1788940708.011552:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035992832 00000100:00100000:1.0:1788940708.011613:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035992960 00000100:00100000:1.0:1788940708.011617:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035992960 00000100:00100000:1.0:1788940708.011643:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 86 00000100:00100000:1.0:1788940708.011653:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2360:x1875840035992832:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940708.016138:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 87 00000100:00100000:0.0:1788940708.016161:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840035992960:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940708.016877:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2360:x1875840035992832:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 5219us (5726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.016890:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 86 00000100:00080000:1.0:1788940708.016925:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940708.018274:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035992704 00000100:00100000:3.0:1788940708.018292:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035992704 00000100:00100000:3.0:1788940708.018368:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 230 00000100:00100000:3.0:1788940708.018379:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840035992704:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940708.018453:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840035992704:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 76us (7202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940708.018460:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 230 00000100:00100000:3.0:1788940708.018511:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035993088 00000100:00100000:3.0:1788940708.018515:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035993088 00000100:00100000:3.0:1788940708.018555:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 50 00000100:00100000:3.0:1788940708.018562:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840035993088:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940708.018592:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840035993088:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 31us (7374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940708.018600:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 50 00000100:00080000:1.0:1788940708.019959:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940708.020213:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940708.021326:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035993216 00000100:00100000:1.0:1788940708.021355:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035993216 00000100:00080000:2.0:1788940708.021556:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940708.021658:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 51 00000100:00100000:1.0:1788940708.021666:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840035993216:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940708.021729:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840035993216:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 65us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940708.021734:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 51 00000100:00100000:0.0:1788940708.025839:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840035992960:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 9676us (14555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940708.025854:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 87 00010000:00010000:3.0:1788940708.425649:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940709.448562:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940710.473682:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940710.928887:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068535296:0@lo:400:kworker.0 00000100:00100000:3.0:1788940710.928957:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940710.929014:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068535808:0@lo:400:kworker.0 00000100:00100000:3.0:1788940710.929038:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940710.929063:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788940710.929069:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068535424:0@lo:400:kworker.0 00000100:00100000:3.0:1788940710.929085:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940710.929098:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068535936:0@lo:400:kworker.0 00000100:00100000:3.0:1788940710.929116:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940710.929153:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068535808 00000100:00100000:3.0:1788940710.929161:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068535808 00000100:00100000:3.0:1788940710.929515:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068535424 00000100:00100000:3.0:1788940710.929519:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068535424 00000100:00100000:3.0:1788940710.929539:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788940710.929547:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068535808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940710.929594:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068535808:12345-0@lo:400:kworker.0 Request processed in 48us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940710.929600:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788940710.929623:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788940710.929628:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068535424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940710.929651:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068535424:12345-0@lo:400:kworker.0 Request processed in 23us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940710.929656:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788940710.929675:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068535936 00000100:00100000:3.0:1788940710.929679:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068535936 00000100:00100000:3.0:1788940710.929713:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788940710.929719:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068535936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940710.929744:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068535936:12345-0@lo:400:kworker.0 Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940710.929749:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788940710.929762:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940710.929766:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940710.929794:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068535424:0@lo:400:kworker.0 00010000:00080000:3.0:1788940710.929804:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a059880 x1875840068535936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940710.929814:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068535936:0@lo:400:kworker.0 00000100:00100000:3.0:1788940710.929821:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068535808:0@lo:400:kworker.0 00000100:00100000:3.0:1788940710.932095:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068535296 00000100:00100000:3.0:1788940710.932111:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068535296 00000100:00100000:3.0:1788940710.932453:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788940710.932464:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068535296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940710.932557:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068535296:12345-0@lo:400:kworker.0 Request processed in 96us (3600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940710.932581:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788940710.932625:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068535680:0@lo:400:kworker.0 00000100:00100000:3.0:1788940710.932653:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940710.932789:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940710.932797:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068535552:0@lo:400:kworker.0 00000100:00100000:3.0:1788940710.932822:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940710.932858:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068535552 00000100:00100000:3.0:1788940710.932862:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068535552 00000100:00100000:3.0:1788940710.932893:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788940710.932898:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068535552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940710.932928:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068535552:12345-0@lo:400:kworker.0 Request processed in 30us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940710.932934:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1788940710.932949:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940710.932984:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068535552:0@lo:400:kworker.0 00000100:00100000:3.0:1788940710.933010:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068535296:0@lo:400:kworker.0 00000100:00100000:1.0:1788940710.933933:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068535680 00000100:00100000:1.0:1788940710.933953:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068535680 00000100:00100000:1.0:1788940710.934012:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940710.934020:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068535680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940710.934071:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068535680:12345-0@lo:400:kworker.0 Request processed in 52us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940710.934077:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788940710.934094:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940710.934116:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134691180 x1875840068535680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940710.934139:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068535680:0@lo:400:kworker.0 00000100:00100000:1.0:1788940711.432645:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940711.432670:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a05a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068536064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940711.432743:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940711.432955:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068536064 00000100:00100000:2.0:1788940711.432973:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068536064 00000100:00100000:2.0:1788940711.433027:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788940711.433038:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068536064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940711.433086:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940711.433142:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068536064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940711.433149:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788940711.433271:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a05a680 x1875840068536064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940711.433290:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a05a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068536064:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940711.496665:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940712.520544:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940712.968318:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940712.968344:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068536192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940712.968425:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940712.970666:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068536192 00000100:00100000:2.0:1788940712.970682:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068536192 00000100:00100000:2.0:1788940712.970741:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788940712.970751:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068536192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940712.970787:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940712.970878:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068536192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (2462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940712.970886:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788940712.970906:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940712.970911:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a041880 x1875840068536192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940712.970932:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068536192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940713.130771:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940713.130840:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035993344 00000100:00100000:1.0:1788940713.130850:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035993344 00000100:00100000:1.0:1788940713.130906:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 232 00000100:00100000:1.0:1788940713.130916:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2358:x1875840035993344:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940713.130995:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2358:x1875840035993344:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 80us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940713.131016:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 232 00000100:00100000:2.0:1788940713.147662:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940713.147704:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940713.147816:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940713.147866:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940713.147898:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035993728 00000100:00100000:2.0:1788940713.147908:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035993728 00000100:00100000:2.0:1788940713.147996:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035993856 00000100:00100000:2.0:1788940713.148000:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035993856 00000100:00100000:2.0:1788940713.148033:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 14 00000100:00100000:2.0:1788940713.148042:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2357:x1875840035993728:12345-192.168.202.17@tcp:9:kworker.0 00000020:00000080:2.0:1788940713.148094:0:8426:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2d52 00000100:00080000:2.0:1788940713.148103:0:8426:0:(import.c:65:import_set_state_nolock()) ffff8f413f180800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940713.148155:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788940713.148621:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+2:2357:x1875840035993728:12345-192.168.202.17@tcp:9:kworker.0 Request processed in 578us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940713.148637:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 14 00000100:00100000:2.0:1788940713.148654:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 15 00000100:00100000:2.0:1788940713.148661:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2357:x1875840035993856:12345-192.168.202.17@tcp:9:kworker.0 00000020:00000080:2.0:1788940713.148683:0:8426:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2d59 00000100:00080000:2.0:1788940713.148696:0:8426:0:(import.c:65:import_set_state_nolock()) ffff8f4002191800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940713.148719:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788940713.148912:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+2:2357:x1875840035993856:12345-192.168.202.17@tcp:9:kworker.0 Request processed in 251us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940713.148928:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 15 00000100:00080000:2.0:1788940713.148966:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940713.148970:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788940713.148983:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940713.148989:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940713.151398:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035993472 00000100:00100000:1.0:1788940713.151415:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035993472 00000100:00100000:1.0:1788940713.151481:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035993600 00000100:00100000:1.0:1788940713.151485:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035993600 00000100:00100000:1.0:1788940713.151513:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 91 00000100:00100000:1.0:1788940713.151701:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035993472:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940713.151796:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035993472:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 268us (4145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940713.151804:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 91 00000100:00100000:1.0:1788940713.151824:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 92 00000100:00100000:1.0:1788940713.151831:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840035993600:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940713.151855:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840035993600:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 25us (4150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940713.151861:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 92 00000100:00080000:2.0:1788940713.152031:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788940713.544612:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788940713.580695:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6703b9d8-8e00-4d48-b07a-3d1d34afc200 00000020:00000080:2.0:1788940713.580705:0:7633:0:(genops.c:885:class_export_put()) final put ffff8f4002192800/6703b9d8-8e00-4d48-b07a-3d1d34afc200 00000020:00000080:0.0:1788940713.580979:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4002192800/6703b9d8-8e00-4d48-b07a-3d1d34afc200 for lustre-OST0001 00000020:00000080:0.0:1788940713.581034:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f4002191800 for lustre-OST0001 00010000:00010000:2.0:1788940714.568325:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788940715.139042:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6703b9d8-8e00-4d48-b07a-3d1d34afc200 00000020:00000080:1.0:1788940715.139054:0:6697:0:(genops.c:885:class_export_put()) final put ffff8f413f181000/6703b9d8-8e00-4d48-b07a-3d1d34afc200 00000020:00000080:2.0:1788940715.140890:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413f181000/6703b9d8-8e00-4d48-b07a-3d1d34afc200 for lustre-OST0000 00000020:00000080:2.0:1788940715.140980:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f413f180800 for lustre-OST0000 00010000:00010000:1.0:1788940715.596050:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940716.040764:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068536320:0@lo:400:kworker.0 00000100:00100000:0.0:1788940716.040937:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940716.040993:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068536832:0@lo:400:kworker.0 00000100:00100000:0.0:1788940716.041023:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940716.041049:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788940716.041054:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068536448:0@lo:400:kworker.0 00000100:00100000:0.0:1788940716.041073:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940716.041085:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068536960:0@lo:400:kworker.0 00000100:00100000:0.0:1788940716.041103:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940716.041159:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068536320 00000100:00100000:2.0:1788940716.041166:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068536320 00000100:00100000:2.0:1788940716.041313:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788940716.041337:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068536320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940716.041396:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068536320:12345-0@lo:400:kworker.0 Request processed in 62us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940716.041403:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788940716.041472:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068536960 00000100:00100000:2.0:1788940716.041476:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068536960 00000100:00100000:2.0:1788940716.041514:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788940716.041520:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a058380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068536960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940716.041786:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a058380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068536960:12345-0@lo:400:kworker.0 Request processed in 264us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940716.041794:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788940716.041813:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788940716.041935:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41420e5500 x1875840068536960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940716.041950:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068536960:0@lo:400:kworker.0 00000100:00100000:2.0:1788940716.041963:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068536320:0@lo:400:kworker.0 00000100:00100000:1.0:1788940716.042063:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068536576:0@lo:400:kworker.0 00000100:00100000:1.0:1788940716.042099:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940716.042135:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940716.042142:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068536704:0@lo:400:kworker.0 00000100:00100000:1.0:1788940716.042165:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940716.042387:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068536832 00000100:00100000:2.0:1788940716.042392:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068536832 00000100:00100000:1.0:1788940716.042455:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068536448 00000100:00100000:1.0:1788940716.042459:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068536448 00000100:00100000:1.0:1788940716.042499:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068536576 00000100:00100000:1.0:1788940716.042502:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068536576 00000100:00100000:2.0:1788940716.043333:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788940716.043345:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068536448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940716.043423:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068536448:12345-0@lo:400:kworker.0 Request processed in 80us (2347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940716.043431:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788940716.043448:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788940716.043455:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068536832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940716.043497:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068536832:12345-0@lo:400:kworker.0 Request processed in 42us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940716.043503:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788940716.043530:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068536704 00000100:00100000:2.0:1788940716.043535:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068536704 00000100:00080000:0.0:1788940716.043974:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940716.043980:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940716.046975:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788940716.046992:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068536576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940716.047090:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068536576:12345-0@lo:400:kworker.0 Request processed in 103us (4990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940716.047098:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788940716.047150:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068536576:0@lo:400:kworker.0 00000100:00100000:1.0:1788940716.047483:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068536448:0@lo:400:kworker.0 00000100:00100000:1.0:1788940716.047496:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068536832:0@lo:400:kworker.0 00000100:00100000:3.0:1788940716.055306:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788940716.055325:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068536704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940716.055431:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068536704:12345-0@lo:400:kworker.0 Request processed in 111us (13263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940716.055454:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788940716.058136:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41420e4e00 x1875840068536704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940716.058155:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068536704:0@lo:400:kworker.0 00000100:00100000:1.0:1788940716.554238:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940716.554259:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068537088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940716.554335:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940716.554617:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068537088 00000100:00100000:2.0:1788940716.554625:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068537088 00000100:00100000:2.0:1788940716.554684:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788940716.554694:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068537088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940716.554729:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940716.554774:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068537088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940716.554781:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788940716.555159:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f40025adc00 x1875840068537088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940716.555179:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068537088:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940716.621316:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940717.641428:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940718.090268:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068537216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940718.090338:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940718.090817:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068537216 00000100:00100000:2.0:1788940718.090827:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068537216 00000100:00100000:2.0:1788940718.090891:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788940718.090900:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068537216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940718.090946:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940718.090995:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068537216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940718.091002:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788940718.091149:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940718.091232:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41420e6300 x1875840068537216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940718.091250:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068537216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940718.270759:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940718.270855:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035993984 00000100:00100000:3.0:1788940718.270866:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035993984 00000100:00100000:3.0:1788940718.270937:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 234 00000100:00100000:3.0:1788940718.270951:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:2359:x1875840035993984:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940718.271059:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:2359:x1875840035993984:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 111us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940718.271067:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 234 00000100:00100000:1.0:1788940718.277948:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940718.278060:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035994112 00000100:00100000:0.0:1788940718.278071:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035994112 00000100:00100000:0.0:1788940718.278157:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 96 00000100:00100000:0.0:1788940718.278168:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840035994112:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940718.278285:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840035994112:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 118us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940718.278293:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 96 00000100:00080000:3.0:1788940718.278559:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940718.289650:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940718.289755:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035994240 00000100:00100000:1.0:1788940718.289767:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035994240 00000100:00080000:3.0:1788940718.289939:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940718.290301:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 97 00000100:00100000:1.0:1788940718.290313:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a05aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2358:x1875840035994240:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940718.290399:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a05aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2358:x1875840035994240:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 89us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940718.290407:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 97 00010000:00010000:2.0:1788940718.664503:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940719.328873:0:11010:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788940719.688550:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940720.722875:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940721.162574:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068537344:0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.162689:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940721.162756:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068537856:0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.162808:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940721.162842:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788940721.162848:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068537472:0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.162887:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940721.162908:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068537984:0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.162945:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940721.162982:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068537600:0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.163006:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940721.163027:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940721.163032:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068537728:0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.163054:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940721.163089:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068537344 00000100:00100000:2.0:1788940721.163099:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068537344 00000100:00100000:2.0:1788940721.163160:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788940721.163169:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068537344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.163389:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068537344:12345-0@lo:400:kworker.0 Request processed in 220us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940721.163398:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788940721.163440:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068537856 00000100:00100000:2.0:1788940721.163445:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068537856 00000100:00100000:2.0:1788940721.163485:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068537472 00000100:00100000:2.0:1788940721.163488:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068537472 00000100:00100000:2.0:1788940721.163500:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068537600 00000100:00100000:2.0:1788940721.163503:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068537600 00000100:00100000:2.0:1788940721.163517:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788940721.163524:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068537856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.163559:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068537856:12345-0@lo:400:kworker.0 Request processed in 35us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940721.163576:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788940721.163588:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788940721.163595:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068537472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.163624:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068537472:12345-0@lo:400:kworker.0 Request processed in 30us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940721.163630:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788940721.163641:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788940721.163647:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068537600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.163677:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068537600:12345-0@lo:400:kworker.0 Request processed in 30us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940721.163683:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788940721.163709:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068537984 00000100:00100000:2.0:1788940721.163712:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068537984 00000100:00100000:2.0:1788940721.163740:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068537728 00000100:00100000:2.0:1788940721.163743:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068537728 00000100:00100000:2.0:1788940721.163766:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788940721.163773:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068537984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.163806:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068537984:12345-0@lo:400:kworker.0 Request processed in 34us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940721.163813:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788940721.163824:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788940721.163830:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068537728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.163860:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068537728:12345-0@lo:400:kworker.0 Request processed in 30us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940721.163866:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788940721.163909:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940721.163914:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940721.163916:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788940721.165130:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41420e7100 x1875840068537728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940721.165154:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068537728:0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.165172:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068537600:0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.165393:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068537472:0@lo:400:kworker.0 00010000:00080000:2.0:1788940721.165410:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41420e5f80 x1875840068537984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940721.165420:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068537984:0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.165433:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068537344:0@lo:400:kworker.0 00000100:00100000:2.0:1788940721.165446:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068537856:0@lo:400:kworker.0 00000100:00100000:3.0:1788940721.687906:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940721.687937:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068538112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940721.688041:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940721.688123:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068538112 00000100:00100000:3.0:1788940721.688132:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068538112 00000100:00100000:3.0:1788940721.688230:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788940721.688242:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068538112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940721.688289:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940721.688344:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068538112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940721.688352:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788940721.688420:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134690000 x1875840068538112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940721.688443:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068538112:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940721.740363:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940722.764293:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940723.209596:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940723.209632:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068538240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940723.209733:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940723.209841:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068538240 00000100:00100000:3.0:1788940723.209851:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068538240 00000100:00100000:3.0:1788940723.209936:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788940723.209948:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068538240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940723.210003:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940723.210058:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068538240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.210065:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788940723.210091:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940723.210131:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4134690000 x1875840068538240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940723.210155:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068538240:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788940723.267826:0:11158:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe67b543b0 20000000:00000080:0.0:1788940723.267850:0:11158:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f4111257000 uarg=0000000000000000 20000000:01000000:0.0:1788940723.267922:0:11158:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788940723.267929:0:11158:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788940723.267935:0:11158:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788940723.269833:0:11159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788940723.270062:0:11158:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788940723.275916:0:11158:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788940723.275966:0:11158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.275996:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2d05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226349 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.276032:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4136234200/0xa1d8aa9164aa2d13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d0c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.276040:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4136234400/0xa1d8aa9164aa2d21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d1a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.276047:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4136235600/0xa1d8aa9164aa2d2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d28 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.276055:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4136234800/0xa1d8aa9164aa2d44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226381 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.276063:0:11158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.276129:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4136234800/0xa1d8aa9164aa2d44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226381 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.276149:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f4136234800/0xa1d8aa9164aa2d44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226381 expref: 12 pid: 5827 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.276168:0:11158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1875840068538368:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940723.276379:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4136235600/0xa1d8aa9164aa2d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2d28 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.276388:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4136235600/0xa1d8aa9164aa2d2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d28 expref: 18 pid: 5828 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.276398:0:11158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1875840068538496:0@lo:104: 00000100:00100000:3.0:1788940723.276460:0:11158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940723.276504:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4136234400/0xa1d8aa9164aa2d21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2d1a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.276513:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4136234400/0xa1d8aa9164aa2d21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d1a expref: 18 pid: 5826 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.276523:0:11158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a045c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1875840068538624:0@lo:104: 00000100:00100000:3.0:1788940723.276545:0:11158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940723.276592:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068538496 00000100:00100000:3.0:1788940723.276602:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068538496 00000100:00100000:3.0:1788940723.276656:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068538624 00000100:00100000:3.0:1788940723.276659:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068538624 00000100:00100000:3.0:1788940723.276678:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940723.276688:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+4:11158:x1875840068538496:12345-0@lo:104: 00010000:00010000:3.0:1788940723.276704:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2d2f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.276757:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940723.276764:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+4:11158:x1875840068538496:12345-0@lo:104: Request processed in 77us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.276772:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788940723.276795:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788940723.276802:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:11158:x1875840068538624:12345-0@lo:104: 00010000:00010000:3.0:1788940723.276811:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2d21 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.276843:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788940723.276849:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:11158:x1875840068538624:12345-0@lo:104: Request processed in 48us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.276880:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788940723.276915:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4136234200/0xa1d8aa9164aa2d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2d0c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.276925:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4136234200/0xa1d8aa9164aa2d13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d0c expref: 18 pid: 5828 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.276934:0:11158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a044380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1875840068538752:0@lo:104: 00000100:00100000:3.0:1788940723.276959:0:11158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940723.276980:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068538752 00000100:00100000:3.0:1788940723.276984:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068538752 00000100:00100000:3.0:1788940723.277001:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940723.277007:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:11158:x1875840068538752:12345-0@lo:104: 00010000:00010000:3.0:1788940723.277016:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2d13 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.277049:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788940723.277054:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a044000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:11158:x1875840068538752:12345-0@lo:104: Request processed in 48us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.277060:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788940723.277090:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226349 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.277099:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2d05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226349 expref: 12 pid: 5827 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.277108:0:11158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1875840068538880:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940723.277138:0:11158:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41073cccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940723.277170:0:11158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1875840068538496:0@lo:104: 00000100:00100000:3.0:1788940723.277179:0:11158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a045c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1875840068538624:0@lo:104: 00000100:00100000:3.0:1788940723.277184:0:11158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a044380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1875840068538752:0@lo:104: 00010000:00010000:1.0:1788940723.277379:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788940723.277387:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2d2f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277396:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235a00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:1.0:1788940723.277400:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2d2f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277410:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2d2f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940723.277417:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2d2f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940723.277423:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940723.277467:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d2f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277474:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940723.277498:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d2f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277518:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4136235a00/0xa1d8aa9164aa2d28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d2f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277536:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940723.277540:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2d21 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277546:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234a00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:1.0:1788940723.277550:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2d21 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277558:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2d21 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940723.277565:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2d21 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940723.277570:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940723.277606:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d21 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277614:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940723.277621:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d21 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277628:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4136234a00/0xa1d8aa9164aa2d1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d21 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277638:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940723.277647:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2d13 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277654:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36e00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:1.0:1788940723.277657:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2d13 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277664:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2d13 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940723.277670:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2d13 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940723.277676:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940723.277692:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d13 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277698:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940723.277718:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d13 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277725:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4113b36e00/0xa1d8aa9164aa2d0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d13 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.277742:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940723.277744:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940723.277747:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940723.277755:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940723.277762:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940723.277776:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41115ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068539264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940723.277822:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940723.277904:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068539264 00000100:00100000:1.0:1788940723.277909:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068539264 00010000:00010000:1.0:1788940723.277936:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4136234200/0xa1d8aa9164aa2d13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d0c expref: 19 pid: 5828 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940723.277965:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788940723.277973:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41080e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068539264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940723.277988:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940723.277993:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4136234200/0xa1d8aa9164aa2d13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d0c expref: 19 pid: 5828 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.278003:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4136234200/0xa1d8aa9164aa2d13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d0c expref: 19 pid: 5828 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.278018:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4136234200/0xa1d8aa9164aa2d13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d0c expref: 19 pid: 5828 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.278032:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940723.278065:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41080e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:3301:x1875840068539264:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.278072:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788940723.278139:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41115ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068539264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940723.279077:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40025ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068539008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940723.279136:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940723.279184:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940723.279241:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41115ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068539136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940723.279265:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940723.279713:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068539008 00000100:00100000:1.0:1788940723.279722:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068539008 00010000:00010000:1.0:1788940723.279757:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4136235600/0xa1d8aa9164aa2d2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d28 expref: 18 pid: 5828 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940723.279796:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068539136 00000100:00100000:1.0:1788940723.279800:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068539136 00010000:00010000:1.0:1788940723.279811:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4136234400/0xa1d8aa9164aa2d21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d1a expref: 19 pid: 5826 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940723.279847:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940723.279865:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068539008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940723.279879:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940723.279885:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4136235600/0xa1d8aa9164aa2d2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d28 expref: 19 pid: 5828 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.279896:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4136235600/0xa1d8aa9164aa2d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d28 expref: 19 pid: 5828 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.279914:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4136235600/0xa1d8aa9164aa2d2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d28 expref: 19 pid: 5828 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.279929:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940723.279977:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:3303:x1875840068539008:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.279984:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940723.280001:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940723.280007:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:3303:x1875840068539136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940723.280014:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940723.280019:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4136234400/0xa1d8aa9164aa2d21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d1a expref: 17 pid: 5826 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.280027:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4136234400/0xa1d8aa9164aa2d21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d1a expref: 17 pid: 5826 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.280036:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4136234400/0xa1d8aa9164aa2d21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d1a expref: 17 pid: 5826 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.280057:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940723.280080:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:3303:x1875840068539136:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.280087:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940723.280126:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41115ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068539136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940723.280134:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40025ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068539008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940723.283000:0:11158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1875840068538368:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940723.284295:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940723.284497:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035994368 00000100:00100000:1.0:1788940723.284511:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035994368 00010000:00010000:1.0:1788940723.284565:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4136234800/0xa1d8aa9164aa2d44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226381 expref: 13 pid: 5827 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940723.284626:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 28 00000100:00100000:1.0:1788940723.284640:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd220973-afce-4e0b-b310-f94af7a18e79+13:2359:x1875840035994368:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940723.284663:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940723.284670:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4136234800/0xa1d8aa9164aa2d44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226381 expref: 13 pid: 5827 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.284685:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4136234800/0xa1d8aa9164aa2d44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226381 expref: 13 pid: 5827 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.284709:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4136234800/0xa1d8aa9164aa2d44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226381 expref: 13 pid: 5827 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940723.284735:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940723.284809:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd220973-afce-4e0b-b310-f94af7a18e79+12:2359:x1875840035994368:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 171us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940723.284844:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 28 00000100:00100000:3.0:1788940723.289498:0:11158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1875840068538880:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940723.289555:0:11158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940723.290918:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940723.291073:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035994496 00000100:00100000:0.0:1788940723.291086:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035994496 00010000:00010000:0.0:1788940723.291144:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2d05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226349 expref: 12 pid: 5827 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940723.291277:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 29 00000100:00100000:0.0:1788940723.291291:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd220973-afce-4e0b-b310-f94af7a18e79+12:2358:x1875840035994496:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940723.291313:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940723.291321:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2d05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226349 expref: 12 pid: 5827 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.291336:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2d05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226349 expref: 12 pid: 5827 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.291359:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2d05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226349 expref: 12 pid: 5827 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.291382:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.291393:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.291414:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.291422:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.291430:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.291451:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.291458:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940723.291464:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.291474:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.291497:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940723.291510:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940723.291581:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a047b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd220973-afce-4e0b-b310-f94af7a18e79+11:2358:x1875840035994496:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 293us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940723.291590:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 29 00010000:00010000:3.0:1788940723.291729:0:11158:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.291739:0:11158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940723.291745:0:11158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4113b37e00/0xa1d8aa9164aa2d60 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940723.372029:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940723.372751:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940723.372789:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940723.372895:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035994880 00000100:00100000:3.0:1788940723.372911:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035994880 00000100:00100000:3.0:1788940723.373007:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035994752 00000100:00100000:3.0:1788940723.373010:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035994752 00000100:00100000:3.0:1788940723.373040:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 101 00000100:00100000:3.0:1788940723.373052:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a05b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2358:x1875840035994880:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940723.373155:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a05b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2358:x1875840035994880:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 105us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.373163:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 101 00000100:00080000:0.0:1788940723.373304:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940723.373415:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 102 00000100:00100000:3.0:1788940723.373424:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a05a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840035994752:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940723.373455:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a05a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840035994752:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 33us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940723.373462:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 102 00000100:00100000:2.0:1788940723.381063:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035994624 00000100:00100000:2.0:1788940723.381086:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035994624 00000100:00100000:2.0:1788940723.385265:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 236 00000100:00100000:2.0:1788940723.385294:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+11:2358:x1875840035994624:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940723.385414:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+11:2358:x1875840035994624:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 132us (13400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940723.385432:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 236 00010000:00010000:3.0:1788940723.784586:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940724.812366:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940725.039300:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940725.041799:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035995008 00000100:00100000:1.0:1788940725.041821:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035995008 00000100:00100000:1.0:1788940725.041953:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 237 00000100:00100000:1.0:1788940725.041967:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+11:5605:x1875840035995008:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940725.041989:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940725.042016:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2d67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2263ab expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940725.042056:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ab expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940725.042070:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ab expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940725.042082:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050e00, rc 0) 00000100:00100000:1.0:1788940725.042173:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+12:5605:x1875840035995008:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 Request processed in 209us (2889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940725.042182:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 237 00000100:00100000:0.0:1788940725.052439:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940725.052583:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035995136 00000100:00100000:3.0:1788940725.052598:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035995136 00000100:00100000:3.0:1788940725.052675:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 238 00000100:00100000:3.0:1788940725.052687:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+12:5605:x1875840035995136:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940725.053137:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+12:5605:x1875840035995136:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 Request processed in 450us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940725.053146:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 238 00000100:00100000:3.0:1788940725.056676:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940725.075126:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035995264 00000100:00100000:1.0:1788940725.075148:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035995264 00000100:00100000:1.0:1788940725.075237:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 239 00000100:00100000:1.0:1788940725.075249:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+12:5605:x1875840035995264:12345-192.168.202.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940725.075564:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+12:5605:x1875840035995264:12345-192.168.202.17@tcp:503:ll_cfg_requeue.0 Request processed in 315us (18901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940725.075584:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 239 00000100:00100000:1.0:1788940725.105596:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940725.105708:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035995392 00000100:00100000:2.0:1788940725.105736:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035995392 00000100:00100000:2.0:1788940725.105811:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 240 00000100:00100000:2.0:1788940725.105825:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+12:5605:x1875840035995392:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940725.105861:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940725.105889:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2d6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2263b2 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940725.105930:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2d6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263b2 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940725.105944:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2d6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263b2 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940725.105956:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6600, rc 0) 00000100:00100000:2.0:1788940725.106036:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:5605:x1875840035995392:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 Request processed in 213us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940725.106043:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 240 00000100:00100000:1.0:1788940725.119762:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940725.123175:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035995520 00000100:00100000:3.0:1788940725.123211:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035995520 00000100:00100000:3.0:1788940725.123297:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 241 00000100:00100000:3.0:1788940725.123311:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:5605:x1875840035995520:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940725.129118:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:5605:x1875840035995520:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 Request processed in 413us (3973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940725.129147:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 241 00000100:00100000:3.0:1788940725.132865:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940725.133136:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035995648 00000100:00100000:1.0:1788940725.133152:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035995648 00000100:00100000:1.0:1788940725.133237:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 242 00000100:00100000:1.0:1788940725.133249:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:5605:x1875840035995648:12345-192.168.202.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940725.133570:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:5605:x1875840035995648:12345-192.168.202.17@tcp:503:ll_cfg_requeue.0 Request processed in 322us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940725.133580:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 242 10000000:01000000:3.0:1788940725.321750:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788940725.321758:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f413f3b7800 from 7 10000000:01000000:3.0:1788940725.321765:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940725.321815:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.321853:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.321866:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940725.321894:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a044380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068539392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940725.321969:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940725.322035:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068539392 00000100:00100000:3.0:1788940725.322041:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411133b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940725.322045:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068539392 00000100:00100000:0.0:1788940725.322095:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788940725.322105:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068539392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940725.322119:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940725.322142:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4136234000/0xa1d8aa9164aa2d7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2d75 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940725.322166:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4136234000/0xa1d8aa9164aa2d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d75 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940725.322179:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4136234000/0xa1d8aa9164aa2d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d75 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940725.322231:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234000, rc 0) 00000100:00100000:0.0:1788940725.322281:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068539392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940725.322292:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788940725.322381:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a044380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068539392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940725.322396:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d7c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.322406:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2d7c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940725.322458:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a044380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068539520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940725.322485:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940725.322502:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411133b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940725.323184:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068539520 00000100:00100000:1.0:1788940725.323234:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068539520 00000100:00100000:1.0:1788940725.323301:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788940725.323313:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068539520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940725.323721:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068539520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 409us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940725.323731:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788940725.323871:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a044380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068539520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940725.323914:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a05bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068539648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940725.323964:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940725.324009:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114393c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940725.324682:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068539648 00000100:00100000:1.0:1788940725.324689:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068539648 00000100:00100000:1.0:1788940725.324742:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788940725.324751:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068539648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940725.324967:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068539648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 217us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940725.324983:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788940725.325088:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a05bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068539648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788940725.326934:0:11215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788940725.327755:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788940725.327779:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940725.327789:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d7c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.327802:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d7c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940725.327828:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788940725.327831:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f410f4f2000 from 7 10000000:01000000:3.0:1788940725.327843:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940725.327880:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.327888:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.327899:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940725.327922:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a045c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068539776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940725.327976:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940725.328780:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411133b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940725.329295:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068539776 00000100:00100000:1.0:1788940725.329315:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068539776 00000100:00100000:1.0:1788940725.329361:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788940725.329381:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068539776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940725.329396:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940725.329412:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2d8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2d83 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940725.329437:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d83 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940725.329448:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d83 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940725.329457:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142051400, rc 0) 00000100:00100000:1.0:1788940725.329516:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068539776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940725.329633:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788940725.332731:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a045c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068539776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940725.332756:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d8a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.332768:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2d8a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940725.332871:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a045c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068539904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940725.332921:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940725.332962:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411133b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940725.332968:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068539904 00000100:00100000:0.0:1788940725.332989:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068539904 00000100:00100000:0.0:1788940725.333102:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788940725.333115:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068539904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940725.333454:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068539904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 341us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940725.333463:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788940725.333539:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a045c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068539904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940725.333569:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a045c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068540032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940725.333630:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940725.337566:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411133b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940725.337587:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068540032 00000100:00100000:1.0:1788940725.337597:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068540032 00000100:00100000:1.0:1788940725.338157:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788940725.338171:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068540032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940725.338649:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068540032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 480us (5016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940725.338657:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788940725.339818:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a045c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068540032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788940725.341924:0:11216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788940725.342297:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788940725.342320:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940725.342331:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d8a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.342344:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d8a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940725.342355:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788940725.342358:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f411876b000 from 7 10000000:01000000:3.0:1788940725.342361:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940725.342398:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.342406:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.342416:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940725.342439:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a045c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068540160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940725.342506:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940725.342552:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411133b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940725.342629:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068540160 00000100:00100000:1.0:1788940725.342648:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068540160 00000100:00100000:1.0:1788940725.342697:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788940725.342707:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068540160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940725.342736:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940725.342749:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4142050400/0xa1d8aa9164aa2d98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2d91 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940725.342772:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4142050400/0xa1d8aa9164aa2d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d91 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940725.342783:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4142050400/0xa1d8aa9164aa2d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d91 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940725.342874:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050400, rc 0) 00000100:00100000:1.0:1788940725.342935:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068540160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940725.342942:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788940725.343093:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a045c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068540160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940725.343106:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d98 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.343123:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2d98 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940725.343171:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a045c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068540288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940725.343217:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940725.343244:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411133b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940725.343298:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068540288 00000100:00100000:1.0:1788940725.343302:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068540288 00000100:00100000:1.0:1788940725.343332:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788940725.343340:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068540288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940725.343590:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068540288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940725.343597:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788940725.343714:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a045c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068540288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940725.343753:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a05b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068540416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940725.343873:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940725.343906:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f179840 going to sleep for 11 seconds 00000100:00100000:1.0:1788940725.343955:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068540416 00000100:00100000:1.0:1788940725.343960:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068540416 00000100:00100000:1.0:1788940725.344053:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788940725.344061:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068540416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940725.344546:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068540416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 484us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940725.344563:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788940725.351958:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a05b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068540416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788940725.353758:0:11217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788940725.354115:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788940725.354139:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940725.354150:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d98 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940725.354162:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2d98 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940725.832613:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940726.280819:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41115ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068540544:0@lo:400:kworker.0 00000100:00100000:3.0:1788940726.280933:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940726.281125:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068540544 00000100:00100000:0.0:1788940726.281138:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068540544 00000100:00100000:0.0:1788940726.281221:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788940726.281232:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068540544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940726.284296:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41115ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068540928:0@lo:400:kworker.0 00000100:00100000:1.0:1788940726.284368:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940726.284414:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068540928 00000100:00100000:1.0:1788940726.284420:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940726.284426:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068540928 00000100:00100000:1.0:1788940726.284428:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41115ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068541056:0@lo:400:kworker.0 00000100:00100000:1.0:1788940726.284455:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940726.284488:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41115ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068540672:0@lo:400:kworker.0 00000100:00100000:2.0:1788940726.284505:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788940726.284513:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940726.284515:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068540928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940726.284530:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41115aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068541184:0@lo:400:kworker.0 00000100:00100000:1.0:1788940726.284549:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940726.284567:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940726.284574:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41115ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068540800:0@lo:400:kworker.0 00000100:00100000:1.0:1788940726.284597:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940726.284656:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068540928:12345-0@lo:400:kworker.0 Request processed in 142us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940726.284665:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788940726.284684:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068541184 00000100:00100000:2.0:1788940726.284697:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068541184 00000100:00100000:0.0:1788940726.284754:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068540544:12345-0@lo:400:kworker.0 Request processed in 3522us (3820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940726.284765:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:0.0:1788940726.284793:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940726.284798:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788940726.284798:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940726.284805:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068541184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940726.284809:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068541056 00000100:00100000:0.0:1788940726.284813:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068541056 00000100:00100000:0.0:1788940726.284859:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068540672 00000100:00100000:2.0:1788940726.284860:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068541184:12345-0@lo:400:kworker.0 Request processed in 55us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940726.284862:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068540672 00000100:00100000:2.0:1788940726.284866:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788940726.284875:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068540800 00000100:00100000:0.0:1788940726.284878:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068540800 00000100:00100000:0.0:1788940726.284896:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788940726.284910:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068541056:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788940726.284912:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41115ac700 x1875840068540928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940726.284941:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41115ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068540928:0@lo:400:kworker.0 00000100:00100000:0.0:1788940726.284941:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068541056:12345-0@lo:400:kworker.0 Request processed in 33us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940726.284947:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788940726.284959:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788940726.284965:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41115ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068541056:0@lo:400:kworker.0 00000100:00100000:0.0:1788940726.284966:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068540672:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788940726.284991:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41115aea00 x1875840068541184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940726.284992:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068540672:12345-0@lo:400:kworker.0 Request processed in 28us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940726.284998:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788940726.285001:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41115aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068541184:0@lo:400:kworker.0 00000100:00100000:0.0:1788940726.285010:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788940726.285013:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41115ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068540672:0@lo:400:kworker.0 00000100:00100000:0.0:1788940726.285015:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068540800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940726.285054:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068540800:12345-0@lo:400:kworker.0 Request processed in 39us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940726.285060:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1788940726.285077:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940726.285124:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41115ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068540800:0@lo:400:kworker.0 00000100:00100000:3.0:1788940726.288122:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41115ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068540544:0@lo:400:kworker.0 00000100:00100000:3.0:1788940726.792448:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068541312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940726.792547:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940726.792644:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068541312 00000100:00100000:3.0:1788940726.792655:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068541312 00000100:00100000:3.0:1788940726.792714:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788940726.792726:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068541312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940726.792774:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940726.792842:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068541312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940726.792851:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788940726.792907:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a046300 x1875840068541312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940726.792931:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068541312:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940726.866218:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940727.880772:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788940728.112766:0:11356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg217-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788940728.337859:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940728.338496:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068541440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940728.338574:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940728.338775:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068541440 00000100:00100000:0.0:1788940728.338784:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068541440 00000100:00100000:0.0:1788940728.338862:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788940728.338873:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068541440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940728.338909:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940728.338957:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a046300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068541440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940728.338965:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788940728.339019:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788940728.339639:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41420e5f80 x1875840068541440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940728.339669:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068541440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940728.494288:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940728.494343:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940728.494447:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035995776 00000100:00100000:0.0:1788940728.494459:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035995776 00000100:00100000:0.0:1788940728.494521:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 253 00000100:00100000:0.0:1788940728.494540:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840035995776:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940728.494609:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840035995776:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 72us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940728.494617:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 253 00000100:00100000:2.0:1788940728.494751:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035995904 00000100:00100000:2.0:1788940728.494756:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035995904 00000100:00100000:2.0:1788940728.494817:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 106 00000100:00100000:2.0:1788940728.494825:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2360:x1875840035995904:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940728.494863:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2360:x1875840035995904:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 39us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940728.494868:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 106 00000100:00080000:0.0:1788940728.494927:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940728.498310:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940728.501395:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035996032 00000100:00100000:0.0:1788940728.501411:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035996032 00000100:00100000:0.0:1788940728.501486:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 107 00000100:00100000:0.0:1788940728.501497:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840035996032:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940728.501579:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840035996032:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 84us (3278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940728.501585:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 107 00000100:00080000:3.0:1788940728.501954:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788940728.904719:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940729.934959:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940730.953209:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940731.400545:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068541696:0@lo:400:kworker.0 00000100:00100000:3.0:1788940731.400638:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940731.400705:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068542208:0@lo:400:kworker.0 00000100:00100000:3.0:1788940731.400734:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940731.400768:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940731.400774:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068541824:0@lo:400:kworker.0 00000100:00100000:3.0:1788940731.400811:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940731.400866:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068541696 00000100:00100000:3.0:1788940731.400876:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068541696 00000100:00100000:3.0:1788940731.400932:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068541824 00000100:00100000:3.0:1788940731.400936:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068541824 00000100:00100000:3.0:1788940731.400971:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788940731.400981:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068541696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940731.401059:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068541696:12345-0@lo:400:kworker.0 Request processed in 78us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940731.401067:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788940731.401099:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788940731.401106:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068541824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940731.401147:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068541824:12345-0@lo:400:kworker.0 Request processed in 41us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940731.401153:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788940731.401173:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068542208 00000100:00100000:3.0:1788940731.401177:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068542208 00000100:00100000:3.0:1788940731.401227:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788940731.401234:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068542208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940731.401265:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068542208:12345-0@lo:400:kworker.0 Request processed in 32us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940731.401271:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788940731.401290:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940731.401295:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940731.401349:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068541824:0@lo:400:kworker.0 00000100:00100000:3.0:1788940731.401359:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068541696:0@lo:400:kworker.0 00010000:00080000:3.0:1788940731.401372:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4141513800 x1875840068542208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940731.401383:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068542208:0@lo:400:kworker.0 00000100:00100000:1.0:1788940731.401477:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068541952:0@lo:400:kworker.0 00000100:00100000:1.0:1788940731.401515:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940731.401547:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788940731.401553:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068541568:0@lo:400:kworker.0 00000100:00100000:1.0:1788940731.401585:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940731.401607:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068542080:0@lo:400:kworker.0 00000100:00100000:1.0:1788940731.401628:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940731.401667:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068542080 00000100:00100000:1.0:1788940731.401671:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068542080 00000100:00100000:1.0:1788940731.401702:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788940731.401709:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068542080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940731.401742:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068542080:12345-0@lo:400:kworker.0 Request processed in 34us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940731.401749:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1788940731.401764:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940731.401792:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068542080:0@lo:400:kworker.0 00000100:00100000:0.0:1788940731.402247:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068541568 00000100:00100000:0.0:1788940731.402253:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068541568 00000100:00100000:0.0:1788940731.402286:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788940731.402293:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068541568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940731.402341:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068541568:12345-0@lo:400:kworker.0 Request processed in 48us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940731.402348:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788940731.402398:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068541568:0@lo:400:kworker.0 00000100:00100000:3.0:1788940731.407199:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068541952 00000100:00100000:3.0:1788940731.407221:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068541952 00000100:00100000:3.0:1788940731.407313:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788940731.407336:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068541952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940731.407483:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068541952:12345-0@lo:400:kworker.0 Request processed in 150us (5966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940731.407514:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788940731.407561:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940731.410147:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4141512300 x1875840068541952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940731.410171:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068541952:0@lo:400:kworker.0 00000100:00100000:3.0:1788940731.916945:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41115aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068542336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940731.917072:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940731.917217:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068542336 00000100:00100000:0.0:1788940731.917230:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068542336 00000100:00100000:0.0:1788940731.917306:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788940731.917317:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068542336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940731.917365:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940731.922817:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068542336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5485us (5729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940731.922838:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788940731.923014:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41115aca80 x1875840068542336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940731.923051:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41115aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068542336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788940731.981235:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788940731.993725:0:11456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 03:58:49 (1788940729) === 00000100:00100000:3.0:1788940732.174619:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940732.174672:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940732.175592:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035996160 00000100:00100000:0.0:1788940732.175611:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035996160 00000100:00100000:0.0:1788940732.175706:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 14 00000100:00100000:0.0:1788940732.175721:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035996160:12345-192.168.202.17@tcp:41:mkdir.0 00000004:00000024:0.0:1788940732.175829:0:7198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788940732.175950:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840035996160:12345-192.168.202.17@tcp:41:mkdir.0 Request processed in 234us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940732.175959:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 14 00000100:00080000:3.0:1788940732.176108:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940732.179277:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035996288 00000100:00100000:2.0:1788940732.179303:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035996288 00000100:00100000:2.0:1788940732.179388:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:2.0:1788940732.179399:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:9695:x1875840035996288:12345-192.168.202.17@tcp:700:mkdir.0 00000100:00100000:2.0:1788940732.179540:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:9695:x1875840035996288:12345-192.168.202.17@tcp:700:mkdir.0 Request processed in 142us (4867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940732.179549:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:3.0:1788940732.187037:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940732.187216:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035996544 00000100:00100000:2.0:1788940732.187232:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035996544 00000100:00100000:2.0:1788940732.187302:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 15 00000100:00100000:2.0:1788940732.187314:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:9695:x1875840035996544:12345-192.168.202.17@tcp:36:mkdir.0 00010000:00010000:2.0:1788940732.187392:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940732.187568:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2c80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226334 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.187612:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f600) 00010000:00010000:2.0:1788940732.187695:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940732.188532:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2d9f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.188547:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2d9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.188557:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2d9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.188602:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2da6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.188611:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2da6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.188618:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2da6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940732.191389:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788940732.191413:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2d9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.191422:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2d9f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.191430:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2d9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.191436:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940732.191440:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2d9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.191448:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2d9f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.191465:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:2.0:1788940732.191468:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940732.191474:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2d9f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.191493:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2d9f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940732.191513:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e1698df reply state 00000000efa441af transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2da6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940732.191522:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940732.192131:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:9695:x1875840035996544:12345-192.168.202.17@tcp:36:mkdir.0 Request processed in 4813us (5102us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788940732.192143:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 15 00010000:00010000:2.0:1788940732.212590:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2da6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.212609:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2da6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.212630:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2da6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.212639:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940732.212645:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2da6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.212654:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2da6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.212675:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f41054d7a00) 00010000:00010000:2.0:1788940732.212679:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940732.212685:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2da6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.212716:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2da6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940732.213817:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940732.213888:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035996672 00000100:00100000:0.0:1788940732.213902:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035996672 00000100:00100000:0.0:1788940732.214008:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 16 00000100:00100000:0.0:1788940732.214020:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:9696:x1875840035996672:12345-192.168.202.17@tcp:101:chmod.0 00010000:00010000:0.0:1788940732.214042:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940732.214079:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235600/0xa1d8aa9164aa2dad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2263b9 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.214155:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2db4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.214170:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2db4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.214183:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2db4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940732.214276:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788940732.214280:0:7198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940732.214326:0:7198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2db4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.214356:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235600/0xa1d8aa9164aa2dad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263b9 expref: 8 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.214374:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2db4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263b9 expref: 7 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.214383:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:0.0:1788940732.214386:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940732.214389:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235c00, rc 0) 00000100:00100000:0.0:1788940732.214463:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:9696:x1875840035996672:12345-192.168.202.17@tcp:101:chmod.0 Request processed in 445us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940732.214471:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 16 00000100:00100000:2.0:1788940732.217747:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940732.217963:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035996928 00000100:00100000:3.0:1788940732.217980:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035996928 00000100:00100000:3.0:1788940732.218070:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 17 00000100:00100000:3.0:1788940732.218083:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:9696:x1875840035996928:12345-192.168.202.17@tcp:36:chmod.0 00010000:00010000:3.0:1788940732.218158:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940732.218226:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2db4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263b9 expref: 7 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.218246:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:3.0:1788940732.218260:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940732.218294:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3c00/0xa1d8aa9164aa2dbb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.218311:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3c00/0xa1d8aa9164aa2dbb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.218344:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3c00/0xa1d8aa9164aa2dbb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940732.219246:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070c023e9 reply state 00000000d46b0f69 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3c00/0xa1d8aa9164aa2dbb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940732.219262:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788940732.219275:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788940732.219616:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:9696:x1875840035996928:12345-192.168.202.17@tcp:36:chmod.0 Request processed in 1531us (1874us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788940732.219627:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 17 00010000:00010000:1.0:1788940732.230494:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3c00/0xa1d8aa9164aa2dbb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.230520:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3c00/0xa1d8aa9164aa2dbb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.230529:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3c00/0xa1d8aa9164aa2dbb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.230536:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41421c3c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940732.230541:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3c00/0xa1d8aa9164aa2dbb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.230550:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3c00/0xa1d8aa9164aa2dbb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.230576:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4112cbf100) 00010000:00010000:1.0:1788940732.230579:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788940732.230585:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3c00/0xa1d8aa9164aa2dbb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.230616:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3c00/0xa1d8aa9164aa2dbb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940732.253431:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940732.253541:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035997056 00000100:00100000:0.0:1788940732.253559:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035997056 00000100:00100000:0.0:1788940732.253637:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:0.0:1788940732.253648:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:9697:x1875840035997056:12345-192.168.202.17@tcp:101:chown.0 00010000:00010000:0.0:1788940732.253681:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940732.253708:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235600/0xa1d8aa9164aa2dc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2263c0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.253813:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234400/0xa1d8aa9164aa2dc9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.253854:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234400/0xa1d8aa9164aa2dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.253870:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234400/0xa1d8aa9164aa2dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940732.253917:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788940732.253920:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940732.253979:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234400/0xa1d8aa9164aa2dc9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.254008:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235600/0xa1d8aa9164aa2dc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263c0 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.254029:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234400/0xa1d8aa9164aa2dc9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263c0 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.254039:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f100) 00010000:00010000:0.0:1788940732.254042:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940732.254047:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234400, rc 0) 00000100:00100000:0.0:1788940732.254126:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:9697:x1875840035997056:12345-192.168.202.17@tcp:101:chown.0 Request processed in 480us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940732.254133:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:0.0:1788940732.265232:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940732.265408:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035997184 00000100:00100000:2.0:1788940732.265429:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035997184 00000100:00100000:2.0:1788940732.265504:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00100000:2.0:1788940732.265516:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a05b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:9697:x1875840035997184:12345-192.168.202.17@tcp:101:chown.0 00010000:00010000:2.0:1788940732.265540:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940732.265563:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa2dd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2263c7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.265692:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2dd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.265708:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.265720:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.265735:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa2dde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.265742:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa2dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.265748:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa2dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.266443:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2de5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.266453:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.266461:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940732.266496:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940732.266500:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940732.266525:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.266537:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.266544:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2dd7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.266552:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.266558:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940732.266562:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.266570:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2dd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.266583:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f100) 00010000:00010000:2.0:1788940732.267316:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940732.267326:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2dd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.267335:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2dd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.267351:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa2dde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.267356:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa2dde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.267362:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa2dde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.267367:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940732.267370:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa2dde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.267376:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa2dde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.267386:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f41054d7a00) 00010000:00010000:2.0:1788940732.267389:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940732.267391:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa2dde lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.267397:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa2dde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.267441:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa2dd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263c7 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.267470:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263c7 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.267478:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:2.0:1788940732.267481:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940732.267483:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7200, rc 0) 00000100:00100000:2.0:1788940732.267569:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a05b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:9697:x1875840035997184:12345-192.168.202.17@tcp:101:chown.0 Request processed in 2054us (2391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940732.267578:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00100000:2.0:1788940732.283173:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940732.283262:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035997440 00000100:00100000:0.0:1788940732.283280:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035997440 00000100:00100000:3.0:1788940732.283484:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 20 00000100:00100000:3.0:1788940732.283500:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:9697:x1875840035997440:12345-192.168.202.17@tcp:36:chown.0 00010000:00010000:3.0:1788940732.283582:0:7198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940732.283619:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2de5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263c7 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.283645:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:3.0:1788940732.283659:0:7198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940732.283693:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2dec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.283710:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.283723:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940732.369633:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1788940732.369660:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788940732.369750:0:7198:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000780bb135 reply state 0000000023f634fd transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940732.369802:0:7198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788940732.369823:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788940732.369964:0:7198:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788940732.369992:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:9697:x1875840035997440:12345-192.168.202.17@tcp:36:chown.0 Request processed in 86490us (86825us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788940732.370003:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 20 00010000:00010000:0.0:1788940732.370256:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.370268:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2dec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.370278:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2dec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.370285:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41421c3e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940732.370291:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2dec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.370300:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2dec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.370326:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4112cbf800) 00010000:00010000:0.0:1788940732.370330:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788940732.370336:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2dec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.370343:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2dec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940732.393461:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940732.395918:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035997568 00000100:00100000:3.0:1788940732.395944:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035997568 00000100:00100000:3.0:1788940732.396063:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 21 00000100:00100000:3.0:1788940732.396077:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:9698:x1875840035997568:12345-192.168.202.17@tcp:101:touch.500 00010000:00010000:3.0:1788940732.396111:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940732.396139:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3600/0xa1d8aa9164aa2df3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2263ce expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788940732.400134:0:5835:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3906us 00010000:00010000:3.0:1788940732.421220:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2000/0xa1d8aa9164aa2dfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.421252:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2000/0xa1d8aa9164aa2dfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.421268:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2000/0xa1d8aa9164aa2dfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.421286:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.421295:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.421302:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426289:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2e08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426332:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426348:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940732.426406:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788940732.426411:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940732.426463:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426481:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2000/0xa1d8aa9164aa2dfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426488:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2000/0xa1d8aa9164aa2dfa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426496:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2000/0xa1d8aa9164aa2dfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426502:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41421c2000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940732.426506:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2000/0xa1d8aa9164aa2dfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426516:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2000/0xa1d8aa9164aa2dfa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426532:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f100) 00010000:00010000:3.0:1788940732.426535:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940732.426542:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2000/0xa1d8aa9164aa2dfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426559:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2000/0xa1d8aa9164aa2dfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426576:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426582:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426588:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426593:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41421c2800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940732.426596:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426601:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426609:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f4112cbf700) 00010000:00010000:3.0:1788940732.426612:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940732.426615:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426620:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426668:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3600/0xa1d8aa9164aa2df3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ce expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426687:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2e08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ce expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.426700:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4112cbf100) 00010000:00010000:3.0:1788940732.426703:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788940732.426706:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41421c3e00, rc 0) 00000100:00100000:3.0:1788940732.427465:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:9698:x1875840035997568:12345-192.168.202.17@tcp:101:touch.500 Request processed in 31383us (34012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940732.427478:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 21 00000100:00100000:0.0:1788940732.431642:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940732.431847:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035997824 00000100:00100000:1.0:1788940732.431862:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035997824 00000100:00100000:1.0:1788940732.431975:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 22 00000100:00100000:1.0:1788940732.431988:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:9698:x1875840035997824:12345-192.168.202.17@tcp:101:touch.500 00010000:00010000:1.0:1788940732.432041:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940732.432069:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa2e0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2263d5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.432454:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.432475:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.432492:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.432510:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa2e1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.432517:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa2e1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.432524:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa2e1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940732.433425:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788940732.433728:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.433743:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.433754:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.433811:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.433819:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e16 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.433827:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.433834:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940732.433839:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.433848:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.433863:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4112cbf100) 00010000:00010000:1.0:1788940732.433866:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940732.433872:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.433889:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940732.433907:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039a5b259 reply state 00000000ddec3945 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa2e1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940732.433917:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788940732.433959:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa2e0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263d5 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.433976:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263d5 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.433984:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f41129a4600) 00010000:00010000:1.0:1788940732.433986:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940732.433989:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142051c00, rc 0) 00000100:00100000:1.0:1788940732.434088:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:9698:x1875840035997824:12345-192.168.202.17@tcp:101:touch.500 Request processed in 2102us (2462us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788940732.434098:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 22 00010000:00010000:0.0:1788940732.446405:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa2e1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.446429:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa2e1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.446439:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa2e1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.446446:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940732.446452:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa2e1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.446461:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa2e1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.446485:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff8f41129a4c00) 00010000:00010000:0.0:1788940732.446490:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940732.446496:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa2e1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.446502:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa2e1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940732.446814:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940732.446905:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035998080 00000100:00100000:0.0:1788940732.446919:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035998080 00000100:00100000:0.0:1788940732.447003:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 23 00000100:00100000:0.0:1788940732.447016:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:9698:x1875840035998080:12345-192.168.202.17@tcp:36:touch.500 00010000:00010000:0.0:1788940732.447102:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940732.447125:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263d5 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.447161:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f41129a4600) 00010000:00010000:0.0:1788940732.447170:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940732.447253:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2e32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.447269:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.447281:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940732.447465:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a40ad02 reply state 0000000030581de8 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940732.447476:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940732.447599:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:9698:x1875840035998080:12345-192.168.202.17@tcp:36:touch.500 Request processed in 585us (792us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788940732.447608:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 23 00010000:00010000:0.0:1788940732.449728:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.449749:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2e32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.449758:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2e32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.449764:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940732.449782:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2e32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.449810:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2e32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.449830:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f410ad9fd00) 00010000:00010000:0.0:1788940732.449834:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940732.449841:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2e32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.449848:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2e32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940732.450600:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940732.450895:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035998208 00000100:00100000:0.0:1788940732.450908:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035998208 00000100:00100000:0.0:1788940732.451018:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 24 00000100:00100000:0.0:1788940732.451030:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:9698:x1875840035998208:12345-192.168.202.17@tcp:101:touch.500 00010000:00010000:0.0:1788940732.451065:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940732.451092:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234a00/0xa1d8aa9164aa2e39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2263dc expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.451165:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234a00/0xa1d8aa9164aa2e39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263dc expref: 10 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.451182:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234a00/0xa1d8aa9164aa2e39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263dc expref: 10 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.451316:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f410ad9f700) 00010000:00010000:0.0:1788940732.451319:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940732.451324:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234a00, rc 0) 00000100:00100000:0.0:1788940732.451415:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:9698:x1875840035998208:12345-192.168.202.17@tcp:101:touch.500 Request processed in 387us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940732.451422:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 24 00000100:00100000:2.0:1788940732.458175:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940732.458747:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035998336 00000100:00100000:3.0:1788940732.458764:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035998336 00000100:00100000:3.0:1788940732.458876:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 16 00000100:00100000:3.0:1788940732.458886:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875840035998336:12345-192.168.202.17@tcp:8:touch.500 00010000:00080000:3.0:1788940732.458932:0:8426:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:3.0:1788940732.458985:0:8426:0:(genops.c:1384:class_connect()) connect: client 9fbe6afa-4201-4af1-bbe2-c715064eeb39, cookie 0xa1d8aa9164aa2e40 00002000:00100000:3.0:1788940732.459012:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9fbe6afa-4201-4af1-bbe2-c715064eeb39/ffff8f413f181000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788940732.459047:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788940732.459400:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788940732.459444:0:8426:0:(import.c:65:import_set_state_nolock()) ffff8f414022b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940732.459548:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2357:x1875840035998336:12345-192.168.202.17@tcp:8:touch.500 Request processed in 660us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940732.459557:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 16 00000100:00100000:2.0:1788940732.468975:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940732.469239:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035998464 00000100:00100000:0.0:1788940732.469253:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035998464 00000100:00100000:0.0:1788940732.469406:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 17 00000100:00100000:0.0:1788940732.469420:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:0:x1875840035998464:12345-192.168.202.17@tcp:2:touch.500 00000100:00080000:3.0:1788940732.469854:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788940732.574308:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1788940732.574336:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000100:00100000:3.0:1788940732.576663:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:0:x1875840035998464:12345-192.168.202.17@tcp:2:touch.500 Request processed in 107230us (107698us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788940732.576679:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 17 00000100:00100000:1.0:1788940732.581737:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940732.581934:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035998720 00000100:00100000:3.0:1788940732.581967:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035998720 00000100:00100000:3.0:1788940732.582051:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 2 00000100:00100000:3.0:1788940732.582064:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:9698:x1875840035998720:12345-192.168.202.17@tcp:35:touch.500 00000100:00100000:3.0:1788940732.582629:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+11:9698:x1875840035998720:12345-192.168.202.17@tcp:35:touch.500 Request processed in 564us (903us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788940732.582639:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 2 00000100:00100000:2.0:1788940732.614673:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940732.616723:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035998848 00000100:00100000:0.0:1788940732.616743:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035998848 00000100:00100000:1.0:1788940732.624447:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 25 00000100:00100000:1.0:1788940732.624475:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+11:9699:x1875840035998848:12345-192.168.202.17@tcp:101:rm.0 00010000:00010000:1.0:1788940732.624511:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940732.624557:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2263e3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.624650:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa2e4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.624667:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa2e4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.624682:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa2e4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940732.624726:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940732.624729:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940732.624789:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa2e4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.624823:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263e3 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.624848:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa2e4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263e3 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.624857:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4112cbf100) 00010000:00010000:1.0:1788940732.624859:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940732.624863:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050c00, rc 0) 00000100:00100000:1.0:1788940732.624967:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+12:9699:x1875840035998848:12345-192.168.202.17@tcp:101:rm.0 Request processed in 497us (10309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940732.624975:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 25 00000100:00100000:2.0:1788940732.631636:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940732.631737:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035999104 00000100:00100000:1.0:1788940732.631781:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035999104 00000100:00100000:1.0:1788940732.631858:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 26 00000100:00100000:1.0:1788940732.631870:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+12:9699:x1875840035999104:12345-192.168.202.17@tcp:101:rm.0 00010000:00010000:1.0:1788940732.631898:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940732.631923:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2263ea expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940732.632041:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788940732.632311:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ea expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.632328:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f100) 00010000:00010000:1.0:1788940732.632331:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940732.632337:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ea expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.632352:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050600, rc 0) 00000100:00100000:1.0:1788940732.632415:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:9699:x1875840035999104:12345-192.168.202.17@tcp:101:rm.0 Request processed in 547us (794us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788940732.632422:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 26 00000100:00100000:0.0:1788940732.638554:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940732.638782:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035999232 00000100:00100000:3.0:1788940732.638799:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035999232 00000100:00100000:3.0:1788940732.638872:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 3 00000100:00100000:3.0:1788940732.638885:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:9699:x1875840035999232:12345-192.168.202.17@tcp:37:rm.0 00000100:00100000:3.0:1788940732.646720:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:9699:x1875840035999232:12345-192.168.202.17@tcp:37:rm.0 Request processed in 7821us (8167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940732.646735:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 3 00000100:00100000:2.0:1788940732.661471:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940732.662925:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035999488 00000100:00100000:1.0:1788940732.662944:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035999488 00000100:00100000:1.0:1788940732.663043:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 4 00000100:00100000:1.0:1788940732.663062:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41057c7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:9699:x1875840035999488:12345-192.168.202.17@tcp:35:rm.0 00000100:00100000:2.0:1788940732.663979:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41057c7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:9699:x1875840035999488:12345-192.168.202.17@tcp:35:rm.0 Request processed in 912us (2517us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788940732.663989:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 4 00000100:00100000:0.0:1788940732.671339:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940732.671462:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035999744 00000100:00100000:3.0:1788940732.671476:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035999744 00000100:00100000:3.0:1788940732.671555:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 27 00000100:00100000:3.0:1788940732.671568:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:9699:x1875840035999744:12345-192.168.202.17@tcp:101:rm.0 00010000:00010000:3.0:1788940732.671608:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940732.671638:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3600/0xa1d8aa9164aa2e63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2263f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.671786:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e6a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.671805:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.671821:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e6a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940732.671861:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788940732.672041:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3600/0xa1d8aa9164aa2e63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263f1 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.672070:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263f1 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940732.672082:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4112cbf100) 00010000:00010000:3.0:1788940732.672085:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940732.672089:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41421c2800, rc 0) 00000100:00100000:2.0:1788940732.673359:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:9699:x1875840035999744:12345-192.168.202.17@tcp:101:rm.0 Request processed in 1782us (2024us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788940732.673374:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 27 00000100:00100000:1.0:1788940732.678664:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940732.678808:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840035999872 00000100:00100000:2.0:1788940732.678821:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840035999872 00000100:00100000:2.0:1788940732.678902:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 28 00000100:00100000:2.0:1788940732.678915:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:9699:x1875840035999872:12345-192.168.202.17@tcp:41:rm.0 00000004:00000024:2.0:1788940732.679031:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788940732.679148:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:9699:x1875840035999872:12345-192.168.202.17@tcp:41:rm.0 Request processed in 234us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940732.679157:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 28 00000100:00100000:2.0:1788940732.686023:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940732.689561:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036000000 00000100:00100000:1.0:1788940732.689583:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036000000 00000100:00100000:1.0:1788940732.689704:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 29 00000100:00100000:1.0:1788940732.689718:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:9699:x1875840036000000:12345-192.168.202.17@tcp:101:rm.0 00010000:00010000:1.0:1788940732.689747:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940732.689791:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa2e78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2263f8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.689883:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e7f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.689902:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.689914:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.689932:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.689938:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.689944:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.690106:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa2e8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.690115:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa2e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.690122:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa2e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940732.690168:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788940732.690173:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940732.690401:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa2e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690417:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa2e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690427:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690434:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690441:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690449:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940732.690454:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690462:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690477:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4112cbf100) 00010000:00010000:2.0:1788940732.690481:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940732.690487:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690505:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa2e7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690524:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690530:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690535:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690540:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940732.690543:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690549:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690556:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff8f41129a4500) 00010000:00010000:2.0:1788940732.690559:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940732.690561:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690567:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa2e86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690608:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa2e78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263f8 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690625:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa2e8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263f8 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.690640:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f410ad9f700) 00010000:00010000:2.0:1788940732.690642:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940732.690646:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4a00, rc 0) 00000100:00100000:2.0:1788940732.690746:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:9699:x1875840036000000:12345-192.168.202.17@tcp:101:rm.0 Request processed in 1031us (4743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940732.690754:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 29 00000100:00100000:1.0:1788940732.698411:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940732.703827:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036000256 00000100:00100000:2.0:1788940732.703850:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036000256 00000100:00100000:2.0:1788940732.703943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 30 00000100:00100000:2.0:1788940732.703956:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:9699:x1875840036000256:12345-192.168.202.17@tcp:36:rm.0 00010000:00010000:2.0:1788940732.704476:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788940732.704517:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa2e8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263f8 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.704546:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234a00/0xa1d8aa9164aa2e39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263dc expref: 16 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.704559:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f410ad9f700) 00010000:00010000:2.0:1788940732.704580:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa2e4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263e3 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.704591:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4112cbf100) 00010000:00010000:2.0:1788940732.704595:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940732.704624:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2e94 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.704663:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2e94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.704675:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2e94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.704694:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2e9b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.704701:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2e9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.704707:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2e9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.704858:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2ea2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.704867:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2ea2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.704875:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2ea2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940732.706820:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788940732.706846:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374010657929ns, next at 375010652765ns, rc = 0 00010000:00010000:2.0:1788940732.706941:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa2ea9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.706961:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa2ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.706989:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa2ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707001:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa2ea9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707008:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa2ea9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707015:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa2ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707365:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940732.707407:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2ea2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707415:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2ea2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707422:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2ea2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707428:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940732.707434:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2ea2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707442:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2ea2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707456:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f41054d7a00) 00010000:00010000:2.0:1788940732.707460:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788940732.707475:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2ea2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707481:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2ea2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707505:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2e94 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707512:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2e94 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707518:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2e94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707523:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940732.707526:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2e94 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707533:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2e94 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707541:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4112cbf100) 00010000:00010000:2.0:1788940732.707544:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940732.707548:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2e94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940732.707554:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2e94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940732.707566:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f939bdc7 reply state 00000000a3ab2cb4 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2e9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940732.707591:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940732.707727:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:9699:x1875840036000256:12345-192.168.202.17@tcp:36:rm.0 Request processed in 3767us (9327us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788940732.707738:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 30 00010000:00010000:0.0:1788940732.710967:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2e9b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.710992:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2e9b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.711001:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2e9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.711009:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940732.711015:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2e9b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.711035:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2e9b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.711068:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff8f41054d7000) 00010000:00010000:0.0:1788940732.711071:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940732.711078:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2e9b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.711107:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2e9b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.711677:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940732.711688:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa2ea9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.711698:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940732.711703:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa2ea9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.711712:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa2ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.711726:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8f41054d7a00) 00010000:00010000:1.0:1788940732.711729:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788940732.711734:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa2ea9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.711740:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa2ea9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.711761:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940732.711763:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940732.711795:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940732.712747:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940732.712866:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036000512 00000100:00100000:3.0:1788940732.712881:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036000512 00000100:00100000:3.0:1788940732.712952:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:3.0:1788940732.712965:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:9699:x1875840036000512:12345-192.168.202.17@tcp:35:rm.0 00000100:00100000:3.0:1788940732.713548:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:9699:x1875840036000512:12345-192.168.202.17@tcp:35:rm.0 Request processed in 582us (811us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788940732.713558:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:2.0:1788940732.717500:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940732.717594:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036000768 00000100:00100000:1.0:1788940732.717607:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036000768 00000100:00100000:1.0:1788940732.717679:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 31 00000100:00100000:1.0:1788940732.717689:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:9699:x1875840036000768:12345-192.168.202.17@tcp:36:rm.0 00010000:00010000:1.0:1788940732.717794:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788940732.717830:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa2e6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263f1 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.717867:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c3e00/0xa1d8aa9164aa2e08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ce expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.717883:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f4112cbf100) 00010000:00010000:1.0:1788940732.717899:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234400/0xa1d8aa9164aa2dc9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263c0 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.717908:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f100) 00010000:00010000:1.0:1788940732.717916:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940732.717947:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa2eb0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.717961:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa2eb0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.717973:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa2eb0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.717985:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa2eb7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.717992:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa2eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.717998:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa2eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.718647:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa2ebe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.718659:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa2ebe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.718668:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa2ebe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940732.719670:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788940732.719693:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa2ebe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.719702:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa2ebe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.719711:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa2ebe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.719717:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940732.719722:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa2ebe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.719731:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa2ebe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.719745:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8f41129a4700) 00010000:00010000:1.0:1788940732.719748:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788940732.719753:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa2ebe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.719785:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa2ebe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.719815:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa2eb0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.719821:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa2eb0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.719827:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa2eb0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.719833:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940732.719835:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa2eb0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.719841:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa2eb0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.720354:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f41129a4e00) 00010000:00010000:1.0:1788940732.720358:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940732.720362:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa2eb0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940732.720368:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa2eb0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940732.720386:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000333650b5 reply state 000000001aa9a9c1 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa2eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940732.720397:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940732.720585:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:9699:x1875840036000768:12345-192.168.202.17@tcp:36:rm.0 Request processed in 2891us (3094us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788940732.720596:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 31 00010000:00010000:0.0:1788940732.737650:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa2eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.737672:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa2eb7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.737682:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa2eb7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.737689:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940732.737695:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa2eb7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.737705:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa2eb7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.737727:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f41129a4000) 00010000:00010000:0.0:1788940732.737731:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940732.737737:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa2eb7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940732.737743:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa2eb7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940733.000864:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940733.451332:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068542464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940733.451445:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940733.451805:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068542464 00000100:00100000:2.0:1788940733.451818:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068542464 00000100:00100000:2.0:1788940733.451902:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788940733.451912:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068542464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940733.451945:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940733.452009:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068542464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940733.452017:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788940733.452782:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940733.452849:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4111331c00 x1875840068542464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940733.452874:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068542464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940733.608558:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940733.608610:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940733.608646:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940733.608690:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940733.608732:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036001152 00000100:00100000:0.0:1788940733.608732:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036001024 00000100:00100000:3.0:1788940733.608744:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036001152 00000100:00100000:0.0:1788940733.608744:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036001024 00000100:00100000:0.0:1788940733.608811:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036001280 00000100:00100000:0.0:1788940733.608815:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036001280 00000100:00100000:0.0:1788940733.608849:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 111 00000100:00100000:0.0:1788940733.608859:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:2358:x1875840036001024:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940733.608943:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:2358:x1875840036001024:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 85us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940733.608950:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 111 00000100:00100000:0.0:1788940733.608967:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 112 00000100:00100000:0.0:1788940733.608972:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2358:x1875840036001280:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940733.608994:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2358:x1875840036001280:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 22us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940733.608999:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 112 00000100:00080000:0.0:1788940733.609118:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940733.609352:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036000896 00000100:00100000:1.0:1788940733.609357:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036000896 00000100:00100000:1.0:1788940733.609405:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 255 00000100:00100000:1.0:1788940733.609413:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:2358:x1875840036000896:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940733.609481:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 62 00000100:00100000:3.0:1788940733.609492:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840036001152:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940733.609526:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:2358:x1875840036000896:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 112us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940733.609533:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 255 00000100:00100000:3.0:1788940733.609541:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840036001152:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 50us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940733.609549:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 62 00010000:00010000:3.0:1788940734.030451:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940735.049888:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940736.072508:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940736.525216:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068542592:0@lo:400:kworker.0 00000100:00100000:2.0:1788940736.525308:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068542720:0@lo:400:kworker.0 00000100:00100000:3.0:1788940736.525333:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940736.525397:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068542976:0@lo:400:kworker.0 00000100:00100000:1.0:1788940736.528108:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068542592 00000100:00100000:1.0:1788940736.528125:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068542592 00000100:00100000:1.0:1788940736.528221:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788940736.528234:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4107279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068542592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940736.531672:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940736.531798:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068543232:0@lo:400:kworker.0 00000100:00100000:2.0:1788940736.531843:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940736.531894:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940736.531902:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068542848:0@lo:400:kworker.0 00000100:00100000:2.0:1788940736.531929:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940736.531982:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068543232 00000100:00100000:2.0:1788940736.531992:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068543232 00000100:00100000:3.0:1788940736.534254:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068543104:0@lo:400:kworker.0 00000100:00100000:3.0:1788940736.534340:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940736.534366:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788940736.534387:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068543232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940736.534488:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068543232:12345-0@lo:400:kworker.0 Request processed in 110us (2642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940736.534499:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1788940736.534563:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41352c0a80 x1875840068543232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940736.534580:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068543232:0@lo:400:kworker.0 00000100:00100000:2.0:1788940736.534754:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068542720 00000100:00100000:2.0:1788940736.534763:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068542720 00000100:00100000:2.0:1788940736.534801:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068542848 00000100:00100000:2.0:1788940736.534805:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068542848 00000100:00100000:2.0:1788940736.534823:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068543104 00000100:00100000:2.0:1788940736.534826:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068543104 00000100:00100000:2.0:1788940736.534842:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788940736.534848:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068542720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940736.534892:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068542720:12345-0@lo:400:kworker.0 Request processed in 44us (3235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940736.534899:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788940736.534911:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788940736.534917:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068542848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940736.534945:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068542848:12345-0@lo:400:kworker.0 Request processed in 28us (3016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940736.534951:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788940736.534964:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788940736.534970:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068543104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940736.535000:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068543104:12345-0@lo:400:kworker.0 Request processed in 30us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940736.535015:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788940736.535056:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068542848:0@lo:400:kworker.0 00000100:00100000:2.0:1788940736.535069:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068542720:0@lo:400:kworker.0 00000100:00100000:3.0:1788940736.535354:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068543104:0@lo:400:kworker.0 00000100:00080000:3.0:1788940736.535393:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940736.535400:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940736.540031:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940736.540278:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068542976 00000100:00100000:3.0:1788940736.540291:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068542976 00000100:00100000:3.0:1788940736.540369:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788940736.540380:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068542976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940736.540461:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068542976:12345-0@lo:400:kworker.0 Request processed in 83us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940736.540469:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1788940736.540498:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940736.540803:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41352c1c00 x1875840068542976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940736.540822:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068542976:0@lo:400:kworker.0 00000100:00100000:1.0:1788940736.541290:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4107279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068542592:12345-0@lo:400:kworker.0 Request processed in 13057us (15955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940736.541302:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788940736.541354:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068542592:0@lo:400:kworker.0 00000100:00100000:2.0:1788940737.035625:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41115ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068543360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940737.035740:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940737.035875:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068543360 00000100:00100000:1.0:1788940737.035887:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068543360 00000100:00100000:1.0:1788940737.035967:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788940737.035979:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068543360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940737.036025:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940737.036085:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068543360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940737.036093:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788940737.036141:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41115ad880 x1875840068543360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940737.036178:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41115ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068543360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940737.100011:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788940737.558886:0:11608:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:2.0:1788940737.652799:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000001:00080000:2.0:1788940737.652831:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788940737.652863:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788940737.653369:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a05b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068543488:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788940737.653484:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940737.653763:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068543488 00000100:00100000:0.0:1788940737.653775:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068543488 00000100:00100000:0.0:1788940737.653846:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788940737.653858:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068543488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788940737.653895:0:6673:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788940737.654420:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa111bb, atime: 0x6aa111bb, ctime: 0x6aa111bb, blocks: 0x1 00010000:00010000:0.0:1788940737.654434:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a0d7277/0xa1d8aa9164aa2ec5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.654456:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1788940737.654461:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940737.654469:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a0d7277/0xa1d8aa9164aa2ec5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.654493:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a0d7277/0xa1d8aa9164aa2ec5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.654507:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a0d7277/0xa1d8aa9164aa2ec5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.654516:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a0d7277/0xa1d8aa9164aa2ec5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940737.654546:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940737.655336:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940737.655350:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a0d7277/0xa1d8aa9164aa2ec5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940737.655364:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234400 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940737.655369:0:7620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a0d7277/0xa1d8aa9164aa2ec5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940737.655382:0:7620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a0d7277/0xa1d8aa9164aa2ec5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940737.655419:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a0d7277/0xa1d8aa9164aa2ec5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940737.655443:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a0d7277/0xa1d8aa9164aa2ec5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940737.655470:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940737.655472:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940737.655474:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940737.658890:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875840068543488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5022us (5395us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788940737.658907:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1788940737.661970:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f413a05b100/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788940737.661995:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a05b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068543488:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788940738.124682:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940738.568461:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940738.568489:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068543616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940738.568565:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940738.568613:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068543616 00000100:00100000:2.0:1788940738.568623:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068543616 00000100:00100000:2.0:1788940738.568681:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788940738.568690:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875840068543616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940738.568734:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940738.568791:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875840068543616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940738.568798:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788940738.568855:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940738.568931:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068543616:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1788940738.698154:0:11657:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc56b38210 20000000:00000080:2.0:1788940738.698171:0:11657:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f4112ff7000 uarg=0000000000000000 20000000:01000000:2.0:1788940738.698234:0:11657:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788940738.698241:0:11657:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788940738.698245:0:11657:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788940738.702240:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788940738.702634:0:11657:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788940738.712642:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788940738.712702:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788940738.712775:0:11657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788940738.712794:0:11657:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788940738.712823:0:11657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940738.712844:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2d67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ab expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940738.712853:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2d6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263b2 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940738.712861:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4136234000/0xa1d8aa9164aa2d7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d75 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940738.712868:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2d8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d83 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940738.712875:0:11657:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4142050400/0xa1d8aa9164aa2d98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2d91 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940738.712882:0:11657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940738.712924:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4142050400/0xa1d8aa9164aa2d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2d91 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940738.712941:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4142050400/0xa1d8aa9164aa2d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d91 expref: 18 pid: 5827 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940738.712956:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875840068543744:0@lo:104: 00000100:00100000:2.0:1788940738.713019:0:11657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940738.713074:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2d83 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940738.713092:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2d8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d83 expref: 18 pid: 5827 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940738.713101:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875840068543872:0@lo:104: 00000100:00100000:2.0:1788940738.713124:0:11657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940738.713150:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4136234000/0xa1d8aa9164aa2d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa2d75 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940738.713157:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f4136234000/0xa1d8aa9164aa2d7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d75 expref: 18 pid: 5826 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940738.713165:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875840068544000:0@lo:104: 00000100:00100000:2.0:1788940738.713216:0:11657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940738.713241:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2d6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263b2 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940738.713252:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2d6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263b2 expref: 12 pid: 5826 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940738.713261:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875840068544128:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940738.713313:0:11657:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2d67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ab expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940738.713321:0:11657:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2d67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ab expref: 12 pid: 5828 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940738.713330:0:11657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875840068544256:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940738.713353:0:11657:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411056e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940738.714078:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788940738.714097:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068543744 00000100:00100000:0.0:1788940738.714106:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068543744 00000100:00100000:0.0:1788940738.714142:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068543872 00000100:00100000:0.0:1788940738.714144:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068543872 00000100:00100000:0.0:1788940738.714154:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068544000 00000100:00100000:0.0:1788940738.714156:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068544000 00000100:00100000:0.0:1788940738.714171:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788940738.714179:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+5:11657:x1875840068543744:12345-0@lo:104: 00010000:00010000:0.0:1788940738.714211:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2d98 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714264:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940738.714270:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+5:11657:x1875840068543744:12345-0@lo:104: Request processed in 92us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940738.714276:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788940738.714292:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788940738.714297:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+4:11657:x1875840068543872:12345-0@lo:104: 00010000:00010000:0.0:1788940738.714303:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2d8a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714333:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788940738.714337:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+4:11657:x1875840068543872:12345-0@lo:104: Request processed in 41us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940738.714342:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788940738.714353:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788940738.714358:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:11657:x1875840068544000:12345-0@lo:104: 00010000:00010000:0.0:1788940738.714372:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2d7c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714404:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788940738.714409:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+3:11657:x1875840068544000:12345-0@lo:104: Request processed in 51us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940738.714414:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788940738.714448:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788940738.714454:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2d98 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714461:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36000 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:0.0:1788940738.714465:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2d98 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714472:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2d98 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940738.714481:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2d98 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940738.714486:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788940738.714514:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d98 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714520:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940738.714539:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d98 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714545:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4113b36000/0xa1d8aa9164aa2d91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d98 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714564:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940738.714567:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2d8a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714572:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37e00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:0.0:1788940738.714575:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2d8a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714581:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2d8a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940738.714587:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2d8a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940738.714592:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788940738.714605:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d8a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714611:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940738.714617:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d8a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714624:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4113b37e00/0xa1d8aa9164aa2d83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d8a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714633:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940738.714636:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa2d7c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714651:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36800 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:0.0:1788940738.714654:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa2d7c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714661:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa2d7c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940738.714679:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa2d7c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940738.714684:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788940738.714698:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d7c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714704:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940738.714728:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d7c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714734:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa2d75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa2d7c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.714747:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940738.714748:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940738.714750:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940738.714756:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940738.714775:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068544384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940738.714805:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940738.714827:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940738.714832:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068544512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940738.714859:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940738.714881:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940738.714888:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068544640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940738.714912:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940738.714935:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068544384 00000100:00100000:0.0:1788940738.714939:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068544384 00010000:00010000:0.0:1788940738.714958:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4142050400/0xa1d8aa9164aa2d98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d91 expref: 19 pid: 5827 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940738.714974:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068544512 00000100:00100000:0.0:1788940738.714976:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068544512 00010000:00010000:0.0:1788940738.714985:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2d8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d83 expref: 20 pid: 5827 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940738.714992:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068544640 00000100:00100000:0.0:1788940738.714995:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068544640 00010000:00010000:0.0:1788940738.715006:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4136234000/0xa1d8aa9164aa2d7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d75 expref: 21 pid: 5826 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940738.715017:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788940738.715022:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a05bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+21:3303:x1875840068544384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940738.715030:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940738.715034:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4142050400/0xa1d8aa9164aa2d98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d91 expref: 21 pid: 5827 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.715044:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4142050400/0xa1d8aa9164aa2d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d91 expref: 21 pid: 5827 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.715057:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940738.715083:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a05bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+21:3303:x1875840068544384:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940738.715095:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788940738.715108:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788940738.715114:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a05a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+20:3303:x1875840068544512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940738.715122:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940738.715126:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2d8a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d83 expref: 20 pid: 5827 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.715135:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2d8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d83 expref: 20 pid: 5827 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.715145:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940738.715166:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a05a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+20:3303:x1875840068544512:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940738.715173:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788940738.715184:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788940738.715209:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41080e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068544640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940738.715216:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940738.715220:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4136234000/0xa1d8aa9164aa2d7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d75 expref: 19 pid: 5826 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.715229:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4136234000/0xa1d8aa9164aa2d7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d75 expref: 19 pid: 5826 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.715238:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940738.715263:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41080e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068544640:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940738.715268:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788940738.715319:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068544640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940738.715352:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068544512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940738.715359:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068544384:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940738.715777:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940738.718013:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940738.718090:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940738.718161:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036001408 00000100:00100000:0.0:1788940738.718170:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036001408 00010000:00010000:0.0:1788940738.718236:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2d6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263b2 expref: 13 pid: 5826 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940738.718268:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036001536 00000100:00100000:0.0:1788940738.718271:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036001536 00010000:00010000:0.0:1788940738.718286:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2d67 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ab expref: 14 pid: 5828 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940738.718303:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 33 00000100:00100000:0.0:1788940738.718311:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd220973-afce-4e0b-b310-f94af7a18e79+14:2359:x1875840036001408:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940738.718322:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940738.718327:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2d6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263b2 expref: 14 pid: 5826 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.718337:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2d6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263b2 expref: 14 pid: 5826 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.718354:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940738.718404:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd220973-afce-4e0b-b310-f94af7a18e79+14:2359:x1875840036001408:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 93us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940738.718411:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 33 00000100:00100000:0.0:1788940738.718428:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 34 00000100:00100000:0.0:1788940738.718434:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2359:x1875840036001536:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940738.718453:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940738.718457:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2d67 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ab expref: 13 pid: 5828 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.718465:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2d67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ab expref: 13 pid: 5828 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.718477:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.718486:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.718502:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.718509:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.718516:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.718536:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.718543:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6400 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940738.718547:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.718555:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.718574:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940738.718585:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940738.718604:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2359:x1875840036001536:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 170us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940738.718611:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 34 00010000:00010000:3.0:1788940738.723546:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142050400/0xa1d8aa9164aa2d98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d91 expref: 18 pid: 5827 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940738.723566:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875840068543744:0@lo:104: 00010000:00010000:3.0:1788940738.723580:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142051400/0xa1d8aa9164aa2d8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d83 expref: 17 pid: 5827 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940738.723603:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875840068543872:0@lo:104: 00010000:00010000:3.0:1788940738.723617:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4136234000/0xa1d8aa9164aa2d7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa2d75 expref: 16 pid: 5826 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940738.723625:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875840068544000:0@lo:104: 00010000:00010000:3.0:1788940738.723637:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc6600/0xa1d8aa9164aa2d6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263b2 expref: 12 pid: 5826 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940738.723645:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875840068544128:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940738.723654:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142050e00/0xa1d8aa9164aa2d67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ab expref: 11 pid: 5828 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940738.723661:0:11657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11657:1875840068544256:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940738.723692:0:11657:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940738.723701:0:11657:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940738.723707:0:11657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940738.723725:0:11657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc6400/0xa1d8aa9164aa2ecc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940738.731963:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940738.732002:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940738.732028:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940738.732061:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036001664 00000100:00100000:2.0:1788940738.732081:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036001664 00000100:00100000:2.0:1788940738.732144:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036001920 00000100:00100000:2.0:1788940738.732148:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036001920 00000100:00100000:2.0:1788940738.732174:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 116 00000100:00100000:2.0:1788940738.732184:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2359:x1875840036001664:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940738.732287:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2359:x1875840036001664:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 104us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940738.732296:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 116 00000100:00100000:2.0:1788940738.732314:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 117 00000100:00100000:2.0:1788940738.732321:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840036001920:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940738.732346:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840036001920:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 26us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940738.732353:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 117 00000100:00100000:2.0:1788940738.732372:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036001792 00000100:00100000:2.0:1788940738.732376:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036001792 00000100:00100000:2.0:1788940738.732523:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 65 00000100:00100000:2.0:1788940738.732589:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840036001792:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940738.732618:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840036001792:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 31us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940738.732624:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 65 00000100:00080000:2.0:1788940738.732641:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940738.732646:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788940739.147541:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788940739.849691:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788940739.849709:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f413f3b7800 from 7 10000000:01000000:0.0:1788940739.849715:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940739.849771:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940739.849784:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940739.849797:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940739.849829:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068544768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940739.849910:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.849989:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003400d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940739.850003:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068544768 00000100:00100000:1.0:1788940739.850013:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068544768 00000100:00100000:1.0:1788940739.850076:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788940739.850086:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410727b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:5830:x1875840068544768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940739.850100:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940739.850115:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f41073d4800/0xa1d8aa9164aa2eda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2ed3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.850139:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f41073d4800/0xa1d8aa9164aa2eda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ed3 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.850151:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f41073d4800/0xa1d8aa9164aa2eda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ed3 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940739.850160:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4800, rc 0) 00000100:00100000:1.0:1788940739.850232:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410727b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068544768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940739.850239:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788940739.851367:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068544768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940739.851390:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2eda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940739.851403:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2eda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940739.851490:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068544896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940739.851531:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.851563:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003400d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940739.851593:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068544896 00000100:00100000:1.0:1788940739.851600:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068544896 00000100:00100000:1.0:1788940739.851639:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788940739.851646:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068544896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940739.852017:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068544896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 370us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940739.852024:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788940739.852157:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068544896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940739.852213:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068545024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940739.852251:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.852320:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003400d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940739.864105:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068545024 00000100:00100000:3.0:1788940739.864123:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068545024 00000100:00100000:3.0:1788940739.864212:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788940739.864237:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068545024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940739.864500:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068545024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 264us (12246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940739.864508:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788940739.864731:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068545024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940739.866496:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:11670:1875840068545152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940739.866569:0:11670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.866615:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940739.866852:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068545152 00000100:00100000:1.0:1788940739.866860:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068545152 00000100:00100000:1.0:1788940739.866904:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788940739.866913:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:11670:x1875840068545152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940739.867140:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:11670:x1875840068545152:12345-0@lo:502:llog_process_th.0 Request processed in 227us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940739.867147:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788940739.867210:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:11670:1875840068545152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940739.867238:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940739.867250:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940739.867253:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788940739.867260:0:11670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f413f3b7800 00000020:00000080:2.0:1788940739.867262:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788940739.867350:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:11670:1875840068545280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940739.867384:0:11670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940739.867421:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411056e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940739.867461:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068545280 00000100:00100000:0.0:1788940739.867466:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068545280 00000100:00100000:0.0:1788940739.867509:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788940739.867517:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:11670:x1875840068545280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940739.867654:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:11670:x1875840068545280:12345-0@lo:502:llog_process_th.0 Request processed in 133us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940739.867663:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788940739.869333:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:11670:1875840068545280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788940739.869371:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940739.869379:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940739.869381:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788940739.869385:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788940739.869721:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788940739.869742:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940739.869752:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2eda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.869764:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2eda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940739.869774:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788940739.869776:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f410f4f2000 from 7 10000000:01000000:3.0:1788940739.869779:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940739.869818:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.869826:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.869835:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940739.869852:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068545408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788940739.869902:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.869943:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41083440c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940739.869957:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068545408 00000100:00100000:3.0:1788940739.869962:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068545408 00000100:00100000:3.0:1788940739.869992:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788940739.869999:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:5830:x1875840068545408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940739.870009:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940739.870020:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f41421c3600/0xa1d8aa9164aa2ee8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2ee1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.870043:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f41421c3600/0xa1d8aa9164aa2ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ee1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.870053:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f41421c3600/0xa1d8aa9164aa2ee8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ee1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.870061:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41421c3600, rc 0) 00000100:00100000:3.0:1788940739.870089:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068545408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940739.870094:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788940739.870121:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068545408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940739.870148:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ee8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.870157:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2ee8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940739.870218:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068545536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940739.870241:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.870261:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41083440c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940739.870273:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068545536 00000100:00100000:3.0:1788940739.870277:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068545536 00000100:00100000:3.0:1788940739.870298:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788940739.870304:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068545536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940739.870864:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068545536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 558us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940739.870871:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788940739.875267:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068545536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940739.875349:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068545664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940739.875426:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.875477:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f40034000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940739.875885:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068545664 00000100:00100000:1.0:1788940739.875894:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068545664 00000100:00100000:1.0:1788940739.875954:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788940739.875964:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068545664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940739.876168:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068545664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940739.876177:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788940739.881935:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068545664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940739.898225:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:11673:1875840068545792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940739.898308:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.898349:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940739.902390:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068545792 00000100:00100000:0.0:1788940739.902414:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068545792 00000100:00100000:1.0:1788940739.902590:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788940739.902604:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:11673:x1875840068545792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940739.902930:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:11673:x1875840068545792:12345-0@lo:502:llog_process_th.0 Request processed in 328us (4621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940739.902937:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788940739.903509:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:11673:1875840068545792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940739.903545:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940739.903556:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940739.903558:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788940739.903565:0:11673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f410f4f2000 00000020:00000080:3.0:1788940739.903568:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788940739.903665:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:11673:1875840068545920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940739.903720:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.904282:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940739.905509:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068545920 00000100:00100000:0.0:1788940739.905520:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068545920 00000100:00100000:1.0:1788940739.905801:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788940739.905813:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:11673:x1875840068545920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940739.906095:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:11673:x1875840068545920:12345-0@lo:502:llog_process_th.0 Request processed in 283us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940739.906103:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788940739.906208:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:11673:1875840068545920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940739.906238:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940739.906245:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940739.906248:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788940739.906257:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788940739.906316:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788940739.906331:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940739.906341:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ee8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940739.906352:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ee8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940739.906363:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788940739.906366:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f411876b000 from 7 10000000:01000000:0.0:1788940739.906368:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940739.906405:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940739.906413:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940739.906423:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940739.906441:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068546048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940739.906475:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940739.906872:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f40034000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940739.906900:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068546048 00000100:00100000:3.0:1788940739.906905:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068546048 00000100:00100000:3.0:1788940739.906930:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788940739.906937:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:5830:x1875840068546048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940739.906947:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940739.906958:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f41421c3c00/0xa1d8aa9164aa2ef6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa2eef expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.906992:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f41421c3c00/0xa1d8aa9164aa2ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2eef expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.907004:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f41421c3c00/0xa1d8aa9164aa2ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa2eef expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.907013:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41421c3c00, rc 0) 00000100:00100000:3.0:1788940739.907046:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068546048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940739.907052:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788940739.907082:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068546048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940739.907094:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.907103:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940739.907163:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068546176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940739.907202:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.907215:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940739.907225:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068546176 00000100:00100000:3.0:1788940739.907228:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068546176 00000100:00100000:3.0:1788940739.907244:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788940739.907249:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068546176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940739.907456:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068546176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940739.907470:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788940739.907496:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068546176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940739.907520:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068546304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940739.907735:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.907750:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940739.907760:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068546304 00000100:00100000:3.0:1788940739.907763:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068546304 00000100:00100000:3.0:1788940739.907779:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788940739.907849:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068546304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940739.907966:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:5830:x1875840068546304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940739.907973:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788940739.908005:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:5830:1875840068546304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940739.908240:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:11674:1875840068546432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940739.908271:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940739.908289:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068546432 00000100:00100000:3.0:1788940739.908292:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068546432 00000100:00100000:3.0:1788940739.908308:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788940739.908313:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:11674:x1875840068546432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940739.908487:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:11674:x1875840068546432:12345-0@lo:502:llog_process_th.0 Request processed in 173us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940739.908494:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788940739.908518:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344300 going to sleep for 11 seconds 00000100:00100000:3.0:1788940739.908612:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:11674:1875840068546432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940739.908637:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940739.908646:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940739.908648:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788940739.908655:0:11674:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f411876b000 00000020:00000080:3.0:1788940739.908657:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788940739.908738:0:11674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:11674:1875840068546560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940739.908767:0:11674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940739.908869:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068546560 00000100:00100000:1.0:1788940739.908874:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068546560 00000100:00100000:1.0:1788940739.908897:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788940739.908904:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:11674:x1875840068546560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940739.909018:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:11674:x1875840068546560:12345-0@lo:502:llog_process_th.0 Request processed in 115us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940739.909025:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788940739.909737:0:11674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344300 going to sleep for 11 seconds 00000100:00100000:3.0:1788940739.909756:0:11674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4141511c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:11674:1875840068546560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940739.909855:0:11674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940739.909862:0:11674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940739.909864:0:11674:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788940739.909869:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788940739.909929:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788940739.909944:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940739.909952:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940739.909964:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940739.915467:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788940740.136783:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940740.136958:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036002048 00000100:00100000:1.0:1788940740.136968:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036002048 00000100:00100000:1.0:1788940740.137025:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 272 00000100:00100000:1.0:1788940740.137035:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+11:5605:x1875840036002048:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940740.137052:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940740.137606:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f41073d5c00/0xa1d8aa9164aa2efd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2263ff expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.137639:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f41073d5c00/0xa1d8aa9164aa2efd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ff expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.137651:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f41073d5c00/0xa1d8aa9164aa2efd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ff expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940740.137672:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5c00, rc 0) 00000100:00100000:1.0:1788940740.137749:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112889850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+12:5605:x1875840036002048:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 Request processed in 714us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940740.137757:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 272 00000100:00100000:1.0:1788940740.158654:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940740.158925:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036002176 00000100:00100000:0.0:1788940740.158936:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036002176 00000100:00100000:0.0:1788940740.158997:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 273 00000100:00100000:0.0:1788940740.159008:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411288b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+12:5605:x1875840036002176:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940740.159361:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411288b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+12:5605:x1875840036002176:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 Request processed in 354us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940740.159370:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 273 00010000:00010000:0.0:1788940740.168453:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940740.176927:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940740.177026:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036002304 00000100:00100000:1.0:1788940740.177037:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036002304 00000100:00100000:1.0:1788940740.177102:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 274 00000100:00100000:1.0:1788940740.177113:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+12:5605:x1875840036002304:12345-192.168.202.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940740.177580:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+12:5605:x1875840036002304:12345-192.168.202.17@tcp:503:ll_cfg_requeue.0 Request processed in 468us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940740.177589:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 274 00000100:00100000:1.0:1788940740.184159:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940740.187422:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036002432 00000100:00100000:3.0:1788940740.187437:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036002432 00000100:00100000:3.0:1788940740.187568:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 275 00000100:00100000:3.0:1788940740.187579:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+12:9969:x1875840036002432:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940740.187887:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+12:9969:x1875840036002432:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 310us (3738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940740.187906:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 275 00000100:00100000:2.0:1788940740.202805:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940740.208029:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036002560 00000100:00100000:1.0:1788940740.208043:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036002560 00000100:00100000:1.0:1788940740.208116:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 276 00000100:00100000:1.0:1788940740.208127:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+12:9969:x1875840036002560:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940740.208441:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+12:9969:x1875840036002560:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 316us (5645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940740.208450:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 276 00000100:00100000:2.0:1788940740.212619:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940740.212727:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036002688 00000100:00100000:3.0:1788940740.212738:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036002688 00000100:00100000:3.0:1788940740.212796:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 277 00000100:00100000:3.0:1788940740.212806:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+12:5605:x1875840036002688:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940740.212823:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940740.212842:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f41421c3e00/0xa1d8aa9164aa2f04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226406 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.212878:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f41421c3e00/0xa1d8aa9164aa2f04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226406 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.212889:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f41421c3e00/0xa1d8aa9164aa2f04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226406 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940740.212899:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41421c3e00, rc 0) 00000100:00100000:3.0:1788940740.212962:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:5605:x1875840036002688:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 Request processed in 157us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940740.212969:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 277 00000100:00100000:2.0:1788940740.215858:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940740.215948:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036002816 00000100:00100000:0.0:1788940740.215958:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036002816 00000100:00100000:0.0:1788940740.216016:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 278 00000100:00100000:0.0:1788940740.216026:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:5605:x1875840036002816:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940740.216370:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:5605:x1875840036002816:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 Request processed in 344us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940740.216379:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 278 00000100:00100000:0.0:1788940740.224321:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940740.225123:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036002944 00000100:00100000:2.0:1788940740.225134:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036002944 00000100:00100000:2.0:1788940740.225212:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 279 00000100:00100000:2.0:1788940740.225224:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:5605:x1875840036002944:12345-192.168.202.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940740.225457:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:5605:x1875840036002944:12345-192.168.202.17@tcp:503:ll_cfg_requeue.0 Request processed in 235us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940740.225466:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 279 00000100:00100000:2.0:1788940740.233644:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940740.233795:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036003072 00000100:00100000:3.0:1788940740.233806:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036003072 00000100:00100000:3.0:1788940740.233868:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 280 00000100:00100000:3.0:1788940740.233879:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:9971:x1875840036003072:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940740.234657:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:9971:x1875840036003072:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 778us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940740.234666:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 280 00000100:00100000:1.0:1788940740.241462:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940740.241727:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036003200 00000100:00100000:0.0:1788940740.241738:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036003200 00000100:00100000:0.0:1788940740.241797:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 281 00000100:00100000:0.0:1788940740.241807:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:9971:x1875840036003200:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788940740.244801:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:9971:x1875840036003200:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 2982us (3338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940740.244815:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 281 00000040:00080000:1.0:1788940740.937085:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788940741.192366:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940741.641814:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068546688:0@lo:400:kworker.0 00000100:00100000:2.0:1788940741.641932:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940741.642593:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068546816:0@lo:400:kworker.0 00000100:00100000:3.0:1788940741.642645:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940741.642736:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068546688 00000100:00100000:1.0:1788940741.642745:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068546688 00000100:00100000:1.0:1788940741.642824:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788940741.642834:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068546688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940741.645014:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940741.645035:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a05bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068546944:0@lo:400:kworker.0 00000100:00100000:3.0:1788940741.645131:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940741.645227:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068546816 00000100:00100000:3.0:1788940741.645235:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068546816 00000100:00100000:3.0:1788940741.650709:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068546944 00000100:00100000:3.0:1788940741.650745:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068546944 00000100:00100000:3.0:1788940741.650809:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788940741.650826:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068546816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940741.650981:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068546816:12345-0@lo:400:kworker.0 Request processed in 161us (8341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940741.650989:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788940741.651015:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788940741.651023:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068546944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940741.651143:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068546944:12345-0@lo:400:kworker.0 Request processed in 121us (6011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940741.651157:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1788940741.651222:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940741.651344:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a05bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068546944:0@lo:400:kworker.0 00000100:00100000:3.0:1788940741.651362:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068546816:0@lo:400:kworker.0 00000100:00100000:1.0:1788940741.651583:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068546688:12345-0@lo:400:kworker.0 Request processed in 8749us (9649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940741.651592:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788940741.651916:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a05a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068547072:0@lo:400:kworker.0 00000100:00100000:1.0:1788940741.651970:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940741.652021:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940741.652027:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068547200:0@lo:400:kworker.0 00000100:00100000:1.0:1788940741.652075:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940741.652113:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068547200 00000100:00100000:1.0:1788940741.652118:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068547200 00000100:00100000:1.0:1788940741.652174:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788940741.652182:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068547200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940741.652250:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068547200:12345-0@lo:400:kworker.0 Request processed in 69us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940741.652272:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1788940741.652289:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940741.652316:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068547200:0@lo:400:kworker.0 00000100:00100000:0.0:1788940741.652538:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068547072 00000100:00100000:0.0:1788940741.652543:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068547072 00000100:00100000:0.0:1788940741.652620:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788940741.652636:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875840068547072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940741.652715:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875840068547072:12345-0@lo:400:kworker.0 Request processed in 88us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940741.652721:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788940741.652753:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a05a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068547072:0@lo:400:kworker.0 00000100:00080000:1.0:1788940741.652818:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940741.652872:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940741.652883:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068547328:0@lo:400:kworker.0 00000100:00100000:3.0:1788940741.652919:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940741.653020:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068547328 00000100:00100000:0.0:1788940741.653024:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068547328 00000100:00100000:0.0:1788940741.653081:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940741.653088:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068547328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940741.653130:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068547328:12345-0@lo:400:kworker.0 Request processed in 43us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940741.653137:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788940741.653276:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788940741.653403:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a059c00 x1875840068547328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940741.653427:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068547328:0@lo:400:kworker.0 00000100:00100000:2.0:1788940741.656433:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068546688:0@lo:400:kworker.0 00000100:00100000:3.0:1788940742.152543:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41115ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068547456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940742.152618:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940742.152875:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068547456 00000100:00100000:2.0:1788940742.152884:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068547456 00000100:00100000:2.0:1788940742.152974:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788940742.152985:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068547456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940742.153020:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940742.153266:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068547456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 283us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940742.153290:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788940742.153399:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41115ac700 x1875840068547456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940742.153444:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41115ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068547456:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940742.218730:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788940742.752344:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1788940743.240578:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940743.688890:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940743.688934:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068547584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940743.689038:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940743.689425:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068547584 00000100:00100000:2.0:1788940743.689438:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068547584 00000100:00100000:2.0:1788940743.689527:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788940743.689539:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068547584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940743.689598:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940743.689660:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068547584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940743.689678:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788940743.689724:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788940743.689730:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f413a05b100, transno 4294967300 00000100:00100000:2.0:1788940743.689754:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068547584:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788940743.690592:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940743.849439:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940743.849498:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940743.849532:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940743.849725:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036003456 00000100:00100000:2.0:1788940743.849739:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036003456 00000100:00100000:2.0:1788940743.849818:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036003712 00000100:00100000:2.0:1788940743.849820:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036003712 00000100:00100000:2.0:1788940743.849844:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 121 00000100:00100000:2.0:1788940743.849856:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a05a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2359:x1875840036003456:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940743.849995:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a05a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2359:x1875840036003456:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 140us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940743.850172:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 121 00000100:00100000:2.0:1788940743.850240:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 122 00000100:00100000:2.0:1788940743.850248:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a05bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840036003712:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940743.850279:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a05bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840036003712:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 32us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940743.850285:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 122 00000100:00080000:2.0:1788940743.850305:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940743.850508:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036003328 00000100:00100000:1.0:1788940743.850514:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036003328 00000100:00100000:1.0:1788940743.850564:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 283 00000100:00100000:1.0:1788940743.850600:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:2358:x1875840036003328:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940743.850632:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:2358:x1875840036003328:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 43us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940743.850639:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 283 00000100:00100000:0.0:1788940743.852435:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940743.852522:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036003584 00000100:00100000:2.0:1788940743.852534:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036003584 00000100:00100000:2.0:1788940743.852644:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 68 00000100:00100000:2.0:1788940743.852658:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a05ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840036003584:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940743.853257:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a05ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840036003584:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 597us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940743.853269:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 68 00000100:00080000:1.0:1788940743.856182:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788940744.266035:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940745.288593:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940746.313790:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940746.762701:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940746.762897:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068547840:0@lo:400:kworker.0 00000100:00100000:1.0:1788940746.763026:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940746.763120:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940746.763126:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068547968:0@lo:400:kworker.0 00000100:00100000:1.0:1788940746.763154:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940746.763224:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068547840 00000100:00100000:1.0:1788940746.763235:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068547840 00000100:00100000:1.0:1788940746.763294:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068547968 00000100:00100000:1.0:1788940746.763298:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068547968 00000100:00100000:1.0:1788940746.763334:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788940746.763344:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068547840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940746.763408:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068547840:12345-0@lo:400:kworker.0 Request processed in 66us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940746.763416:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788940746.763454:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788940746.763460:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068547968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940746.763501:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068547968:12345-0@lo:400:kworker.0 Request processed in 41us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940746.763507:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1788940746.763533:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940746.763590:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068547968:0@lo:400:kworker.0 00000100:00100000:1.0:1788940746.763602:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068547840:0@lo:400:kworker.0 00000100:00100000:3.0:1788940746.778347:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940746.778393:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068548096:0@lo:400:kworker.0 00000100:00100000:3.0:1788940746.778502:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940746.778840:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068548096 00000100:00100000:1.0:1788940746.778853:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068548096 00000100:00100000:1.0:1788940746.778956:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788940746.778970:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068548096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940746.779041:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068548096:12345-0@lo:400:kworker.0 Request processed in 75us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940746.779050:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788940746.779077:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940746.779340:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068548096:0@lo:400:kworker.0 00000100:00100000:0.0:1788940746.780744:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068547712:0@lo:400:kworker.0 00000100:00100000:0.0:1788940746.780836:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940746.781236:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068548352:0@lo:400:kworker.0 00000100:00100000:2.0:1788940746.781281:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940746.781513:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068548352 00000100:00100000:0.0:1788940746.781522:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068548352 00000100:00100000:0.0:1788940746.781600:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788940746.781610:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068548352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940746.781708:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068548352:12345-0@lo:400:kworker.0 Request processed in 100us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940746.781717:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1788940746.781770:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41352c1880 x1875840068548352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940746.781786:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068548352:0@lo:400:kworker.0 00000100:00100000:3.0:1788940746.781806:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068547712 00000100:00100000:3.0:1788940746.781812:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068547712 00000100:00100000:0.0:1788940746.781812:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940746.781820:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068548224:0@lo:400:kworker.0 00000100:00100000:0.0:1788940746.781855:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940746.781856:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788940746.781864:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068547712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940746.781886:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068548224 00000100:00100000:0.0:1788940746.781890:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068548224 00000100:00100000:3.0:1788940746.781915:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068547712:12345-0@lo:400:kworker.0 Request processed in 52us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940746.781925:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788940746.781932:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788940746.781933:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a05b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068548224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940746.781964:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a05b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068548224:12345-0@lo:400:kworker.0 Request processed in 33us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940746.781968:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068548224:0@lo:400:kworker.0 00000100:00100000:0.0:1788940746.781971:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788940746.781977:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068547712:0@lo:400:kworker.0 00000100:00080000:2.0:1788940746.782353:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940746.782360:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940747.273724:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068548480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940747.273852:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940747.274104:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068548480 00000100:00100000:2.0:1788940747.274116:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068548480 00000100:00100000:2.0:1788940747.274235:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788940747.274248:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068548480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940747.274298:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940747.274377:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068548480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940747.274386:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788940747.274950:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f411141c700 x1875840068548480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940747.274978:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068548480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788940747.339151:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940748.361819:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940748.808868:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940748.808902:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068548608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940748.809013:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940748.809671:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068548608 00000100:00100000:2.0:1788940748.809685:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068548608 00000100:00100000:2.0:1788940748.809782:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788940748.809795:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068548608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940748.809850:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940748.810167:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068548608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 373us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940748.810175:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788940748.814920:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940748.816135:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068548608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940748.971292:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940748.971346:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940748.971386:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940748.971434:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940748.971434:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036004096 00000100:00100000:0.0:1788940748.971446:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036004096 00000100:00100000:1.0:1788940748.971463:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036003968 00000100:00100000:1.0:1788940748.971467:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036003968 00000100:00100000:1.0:1788940748.971526:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036004224 00000100:00100000:1.0:1788940748.971529:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036004224 00000100:00100000:0.0:1788940748.971531:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 71 00000100:00100000:0.0:1788940748.971543:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840036004096:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940748.971549:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 126 00000100:00100000:1.0:1788940748.971555:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840036003968:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940748.971677:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840036004096:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 135us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940748.971678:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036003840 00000100:00100000:2.0:1788940748.971683:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036003840 00000100:00100000:0.0:1788940748.971697:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 71 00000100:00100000:2.0:1788940748.971713:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 285 00000100:00100000:2.0:1788940748.971721:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:2361:x1875840036003840:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940748.971801:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 127 00000100:00100000:3.0:1788940748.971812:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2361:x1875840036004224:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940748.971863:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840036003968:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 307us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940748.971871:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 126 00000100:00100000:3.0:1788940748.980947:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2361:x1875840036004224:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 9120us (9495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940748.980947:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:2361:x1875840036003840:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 9209us (9652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940748.980967:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 127 00000100:00100000:2.0:1788940748.985120:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 285 00000100:00080000:1.0:1788940748.985379:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940748.985390:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788940749.384570:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940750.155591:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788940750.408537:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940751.432670:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940751.881281:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068548736:0@lo:400:kworker.0 00000100:00100000:1.0:1788940751.881388:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940751.881458:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068549248:0@lo:400:kworker.0 00000100:00100000:1.0:1788940751.881488:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940751.881522:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940751.881528:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068549120:0@lo:400:kworker.0 00000100:00100000:1.0:1788940751.881556:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940751.881583:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068548992:0@lo:400:kworker.0 00000100:00100000:1.0:1788940751.881685:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940751.881702:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788940751.881708:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068548864:0@lo:400:kworker.0 00000100:00100000:1.0:1788940751.881761:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940751.881779:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068549376:0@lo:400:kworker.0 00000100:00100000:1.0:1788940751.881801:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940751.881832:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068549248 00000100:00100000:1.0:1788940751.881843:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068549248 00000100:00100000:1.0:1788940751.881905:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068548992 00000100:00100000:1.0:1788940751.881908:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068548992 00000100:00100000:1.0:1788940751.881931:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068548864 00000100:00100000:1.0:1788940751.881934:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068548864 00000100:00100000:1.0:1788940751.881951:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788940751.881960:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068549248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940751.882020:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068549248:12345-0@lo:400:kworker.0 Request processed in 61us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940751.882030:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788940751.882049:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788940751.882055:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068548992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940751.882083:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068548992:12345-0@lo:400:kworker.0 Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940751.882089:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788940751.882100:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788940751.882105:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068548864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940751.882145:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068548864:12345-0@lo:400:kworker.0 Request processed in 39us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940751.882151:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1788940751.882168:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940751.882242:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068548864:0@lo:400:kworker.0 00000100:00100000:1.0:1788940751.882255:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068548992:0@lo:400:kworker.0 00000100:00100000:1.0:1788940751.882289:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068549248:0@lo:400:kworker.0 00000100:00100000:0.0:1788940751.882968:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068549120 00000100:00100000:0.0:1788940751.882976:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068549120 00000100:00100000:0.0:1788940751.883031:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068549376 00000100:00100000:0.0:1788940751.883035:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068549376 00000100:00100000:0.0:1788940751.883071:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788940751.883081:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068549120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940751.883149:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068549120:12345-0@lo:400:kworker.0 Request processed in 70us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940751.883157:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788940751.883170:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788940751.883177:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068549376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940751.883230:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068549376:12345-0@lo:400:kworker.0 Request processed in 54us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940751.883237:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788940751.883339:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068549120:0@lo:400:kworker.0 00000100:00100000:2.0:1788940751.884226:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068548736 00000100:00100000:2.0:1788940751.884236:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068548736 00000100:00100000:2.0:1788940751.884290:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788940751.884298:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068548736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940751.884382:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068548736:12345-0@lo:400:kworker.0 Request processed in 85us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940751.884388:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:1.0:1788940751.884870:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940751.884876:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788940751.884915:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f41352c1880 x1875840068549376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940751.884958:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068549376:0@lo:400:kworker.0 00000100:00100000:0.0:1788940751.887242:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068548736:0@lo:400:kworker.0 00000100:00100000:0.0:1788940752.394650:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940752.394682:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f410f539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068549504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940752.394776:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940752.394954:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068549504 00000100:00100000:3.0:1788940752.394965:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068549504 00000100:00100000:3.0:1788940752.395045:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788940752.395066:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a059f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068549504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940752.395117:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940752.395183:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a059f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068549504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940752.395213:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788940752.395963:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f410f539180 x1875840068549504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940752.395990:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f410f539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068549504:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788940752.458301:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940753.480793:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940753.933097:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068549632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940753.933244:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940753.933682:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068549632 00000100:00100000:2.0:1788940753.933695:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068549632 00000100:00100000:2.0:1788940753.933812:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788940753.933823:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068549632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940753.933874:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940753.933950:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068549632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940753.933958:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788940753.935748:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940753.935876:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068549632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940754.097476:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940754.097518:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940754.097548:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940754.097673:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940754.097764:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036004352 00000100:00100000:2.0:1788940754.097777:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036004352 00000100:00100000:2.0:1788940754.097835:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 287 00000100:00100000:2.0:1788940754.097844:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:2358:x1875840036004352:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940754.097936:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:2358:x1875840036004352:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 92us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940754.097945:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 287 00000100:00100000:3.0:1788940754.098267:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036004608 00000100:00100000:3.0:1788940754.098273:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036004608 00000100:00100000:3.0:1788940754.098336:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00100000:3.0:1788940754.098345:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2357:x1875840036004608:12345-192.168.202.17@tcp:9:kworker.0 00000020:00000080:3.0:1788940754.098371:0:6673:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2e40 00000100:00080000:3.0:1788940754.098385:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8f414022b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788940754.098432:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1788940754.098718:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+2:2357:x1875840036004608:12345-192.168.202.17@tcp:9:kworker.0 Request processed in 374us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940754.098724:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00080000:0.0:1788940754.098822:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940754.098917:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036004480 00000100:00100000:1.0:1788940754.098930:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036004480 00000100:00100000:1.0:1788940754.098982:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036004736 00000100:00100000:1.0:1788940754.098986:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036004736 00000100:00100000:1.0:1788940754.099021:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 131 00000100:00100000:1.0:1788940754.099031:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840036004480:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940754.099063:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840036004480:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 36us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940754.099068:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 131 00000100:00100000:1.0:1788940754.099078:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 132 00000100:00100000:1.0:1788940754.099082:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840036004736:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940754.099095:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840036004736:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 13us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940754.099099:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 132 00010000:00010000:1.0:1788940754.099281:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940754.099514:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788940754.505648:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940755.534875:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940756.554638:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940757.006680:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f410f539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068549760:0@lo:400:kworker.0 00000100:00100000:1.0:1788940757.006790:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940757.006865:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f410f53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068550272:0@lo:400:kworker.0 00000100:00100000:1.0:1788940757.006932:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940757.006965:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940757.006971:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f410f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068550144:0@lo:400:kworker.0 00000100:00100000:1.0:1788940757.006999:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940757.007027:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f410f538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068549888:0@lo:400:kworker.0 00000100:00100000:1.0:1788940757.007050:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940757.007069:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f410f53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068550400:0@lo:400:kworker.0 00000100:00100000:1.0:1788940757.007089:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940757.007106:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940757.007111:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f410f538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068550016:0@lo:400:kworker.0 00000100:00100000:1.0:1788940757.007132:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940757.007166:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068549760 00000100:00100000:1.0:1788940757.007176:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068549760 00000100:00100000:1.0:1788940757.007284:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788940757.007295:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068549760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940757.007355:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068549760:12345-0@lo:400:kworker.0 Request processed in 61us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940757.007363:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788940757.007406:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068550272 00000100:00100000:1.0:1788940757.007410:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068550272 00000100:00100000:1.0:1788940757.007447:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068549888 00000100:00100000:1.0:1788940757.007449:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068549888 00000100:00100000:1.0:1788940757.007460:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068550016 00000100:00100000:1.0:1788940757.007463:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068550016 00000100:00100000:1.0:1788940757.007476:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788940757.007483:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068550272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940757.007514:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068550272:12345-0@lo:400:kworker.0 Request processed in 31us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940757.007527:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788940757.007550:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788940757.007557:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068549888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940757.007588:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068549888:12345-0@lo:400:kworker.0 Request processed in 32us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940757.007595:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788940757.007606:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788940757.007612:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068550016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940757.007640:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068550016:12345-0@lo:400:kworker.0 Request processed in 28us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940757.007644:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788940757.007693:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f410f538380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068550016:0@lo:400:kworker.0 00000100:00100000:1.0:1788940757.007705:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f410f538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068549888:0@lo:400:kworker.0 00000100:00100000:1.0:1788940757.007733:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f410f539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068549760:0@lo:400:kworker.0 00000100:00100000:1.0:1788940757.007744:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f410f53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068550272:0@lo:400:kworker.0 00000100:00100000:0.0:1788940757.008711:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068550144 00000100:00100000:0.0:1788940757.008721:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068550144 00000100:00100000:0.0:1788940757.008790:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068550400 00000100:00100000:0.0:1788940757.008795:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068550400 00000100:00100000:0.0:1788940757.008830:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788940757.008842:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068550144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940757.008936:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068550144:12345-0@lo:400:kworker.0 Request processed in 97us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940757.008943:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788940757.008958:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788940757.008964:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068550400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940757.009001:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068550400:12345-0@lo:400:kworker.0 Request processed in 38us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940757.009007:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788940757.009031:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940757.009035:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940757.009038:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788940757.009165:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f410f53a300 x1875840068550400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940757.009348:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f410f53a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068550400:0@lo:400:kworker.0 00000100:00100000:0.0:1788940757.009397:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f410f53aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068550144:0@lo:400:kworker.0 00000100:00100000:2.0:1788940757.513237:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f410f53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068550528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940757.513351:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940757.514146:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068550528 00000100:00100000:0.0:1788940757.514162:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068550528 00000100:00100000:0.0:1788940757.514275:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788940757.514287:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068550528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940757.514350:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940757.518841:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068550528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4534us (5470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940757.518864:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1788940757.524132:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f410f53b480 x1875840068550528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940757.524173:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f410f53b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068550528:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788940757.578377:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788940758.121590:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000020:00000080:0.0:1788940758.121602:0:6697:0:(genops.c:885:class_export_put()) final put ffff8f413f181000/9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000020:00000080:2.0:1788940758.125855:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413f181000/9fbe6afa-4201-4af1-bbe2-c715064eeb39 for lustre-OST0000 00000020:00000080:2.0:1788940758.126787:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f414022b000 for lustre-OST0000 00010000:00010000:0.0:1788940758.600576:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940759.048713:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940759.048747:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068550656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940759.048847:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940759.049027:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068550656 00000100:00100000:3.0:1788940759.049038:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068550656 00000100:00100000:3.0:1788940759.049148:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788940759.049159:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f539180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068550656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940759.049232:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940759.049291:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f539180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068550656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940759.049299:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1788940759.049461:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940759.049506:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068550656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940759.210361:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940759.210408:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940759.210488:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940759.210539:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036005120 00000100:00100000:1.0:1788940759.210555:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036005120 00000100:00100000:3.0:1788940759.210607:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036004992 00000100:00100000:3.0:1788940759.210614:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036004992 00000100:00100000:1.0:1788940759.210640:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 136 00000100:00100000:1.0:1788940759.210654:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2361:x1875840036005120:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940759.210750:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036004864 00000100:00100000:0.0:1788940759.210757:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036004864 00000100:00100000:1.0:1788940759.210765:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2361:x1875840036005120:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 114us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940759.210972:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 289 00000100:00100000:0.0:1788940759.210981:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4112fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2361:x1875840036004864:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940759.211015:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4112fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2361:x1875840036004864:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 35us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940759.211022:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 289 00000100:00100000:2.0:1788940759.212624:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 137 00000100:00100000:2.0:1788940759.212651:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840036004992:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940759.212726:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840036004992:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 89us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940759.212754:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 137 00000100:00080000:2.0:1788940759.212791:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940759.215290:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 136 00010000:00010000:3.0:1788940759.626540:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940760.399951:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788940760.655315:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940761.677806:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940762.125084:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068550912:0@lo:400:kworker.0 00000100:00100000:3.0:1788940762.125208:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940762.125314:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940762.125321:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068551040:0@lo:400:kworker.0 00000100:00100000:1.0:1788940762.125466:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068550784:0@lo:400:kworker.0 00000100:00100000:2.0:1788940762.125997:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068550912 00000100:00100000:2.0:1788940762.126009:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068550912 00000100:00100000:2.0:1788940762.126072:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788940762.126083:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068550912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940762.128350:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940762.129283:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068550784 00000100:00100000:0.0:1788940762.129296:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068550784 00000100:00100000:0.0:1788940762.129355:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788940762.129366:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068550784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940762.129539:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068550784:12345-0@lo:400:kworker.0 Request processed in 174us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940762.129548:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788940762.129677:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068550784:0@lo:400:kworker.0 00000100:00100000:3.0:1788940762.129976:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940762.130221:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068551168:0@lo:400:kworker.0 00000100:00100000:3.0:1788940762.130257:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940762.130294:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068551168 00000100:00100000:3.0:1788940762.130298:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068551168 00000100:00100000:3.0:1788940762.130344:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788940762.130353:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068551168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940762.130393:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068551168:12345-0@lo:400:kworker.0 Request processed in 43us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940762.130399:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788940762.130638:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068550912:12345-0@lo:400:kworker.0 Request processed in 4556us (5451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940762.130649:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788940762.130669:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068551040 00000100:00100000:2.0:1788940762.130672:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068551040 00000100:00100000:2.0:1788940762.130696:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788940762.130703:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068551040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940762.130734:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068551040:12345-0@lo:400:kworker.0 Request processed in 33us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940762.130741:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1788940762.130763:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940762.130769:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940762.130790:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068551040:0@lo:400:kworker.0 00000100:00100000:2.0:1788940762.130803:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068550912:0@lo:400:kworker.0 00000100:00100000:3.0:1788940762.132034:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068551168:0@lo:400:kworker.0 00000100:00100000:1.0:1788940762.132130:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068551296:0@lo:400:kworker.0 00000100:00100000:1.0:1788940762.132985:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940762.133109:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940762.133123:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068551424:0@lo:400:kworker.0 00000100:00100000:3.0:1788940762.133205:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940762.133263:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068551424 00000100:00100000:3.0:1788940762.133272:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068551424 00000100:00100000:3.0:1788940762.133338:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788940762.133350:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068551424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940762.133405:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068551424:12345-0@lo:400:kworker.0 Request processed in 59us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940762.133413:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788940762.133591:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788940762.133623:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f4002580700 x1875840068551424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940762.133637:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068551424:0@lo:400:kworker.0 00000100:00100000:2.0:1788940762.140997:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068551296 00000100:00100000:2.0:1788940762.141021:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068551296 00000100:00100000:2.0:1788940762.141184:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788940762.141212:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068551296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940762.141349:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068551296:12345-0@lo:400:kworker.0 Request processed in 140us (8365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940762.141375:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788940762.144311:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068551296:0@lo:400:kworker.0 00000100:00080000:1.0:1788940762.149016:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940762.647494:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940762.647519:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f410f538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068551552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940762.647588:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940762.647708:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068551552 00000100:00100000:1.0:1788940762.647717:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068551552 00000100:00100000:1.0:1788940762.647769:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788940762.647779:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068551552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940762.647813:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940762.647870:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068551552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940762.647877:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1788940762.647996:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f410f538000 x1875840068551552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940762.648038:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f410f538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068551552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788940762.697976:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940763.722701:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940764.176976:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940764.176998:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068551680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940764.177064:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940764.177334:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068551680 00000100:00100000:1.0:1788940764.177354:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068551680 00000100:00100000:1.0:1788940764.177413:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788940764.178318:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068551680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940764.178360:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940764.178415:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068551680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 994us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940764.179664:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1788940764.179840:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940764.180604:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068551680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940764.331146:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940764.331257:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940764.331285:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940764.331318:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036005504 00000100:00100000:2.0:1788940764.331328:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036005504 00000100:00100000:2.0:1788940764.331388:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036005376 00000100:00100000:2.0:1788940764.331393:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036005376 00000100:00100000:3.0:1788940764.331407:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036005248 00000100:00100000:3.0:1788940764.331423:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036005248 00000100:00100000:2.0:1788940764.331429:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 141 00000100:00100000:2.0:1788940764.331443:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840036005504:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940764.331498:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 291 00000100:00100000:3.0:1788940764.331513:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840036005248:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940764.331551:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840036005504:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 110us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940764.331560:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 141 00000100:00100000:3.0:1788940764.331584:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840036005248:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 73us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940764.331594:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 291 00000100:00100000:2.0:1788940764.331602:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 142 00000100:00100000:2.0:1788940764.331625:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2360:x1875840036005376:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940764.331668:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2360:x1875840036005376:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 45us (381us total) trans 0 rc 0/0 00000100:00080000:3.0:1788940764.331678:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940764.331679:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 142 00010000:00010000:1.0:1788940764.746183:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788940765.037599:0:11840:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:59:21 (1788940761) 00010000:00010000:1.0:1788940765.768348:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940766.794520:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940767.241820:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068552064:0@lo:400:kworker.0 00000100:00100000:0.0:1788940767.241906:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068551936:0@lo:400:kworker.0 00000100:00100000:3.0:1788940767.241909:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940767.241982:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068552192:0@lo:400:kworker.0 00000100:00100000:3.0:1788940767.241993:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068552064 00000100:00100000:3.0:1788940767.242000:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068552064 00000100:00100000:2.0:1788940767.242044:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068551808:0@lo:400:kworker.0 00000100:00100000:3.0:1788940767.242055:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788940767.242065:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068552064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940767.244205:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940767.244273:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068552448:0@lo:400:kworker.0 00000100:00100000:0.0:1788940767.244327:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940767.247216:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068552448 00000100:00100000:0.0:1788940767.247232:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068552448 00000100:00100000:0.0:1788940767.247304:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788940767.247314:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068552448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940767.247826:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068552448:12345-0@lo:400:kworker.0 Request processed in 513us (3497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940767.247835:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1788940767.249168:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413f871500 x1875840068552448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788940783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940767.249203:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f871500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068552448:0@lo:400:kworker.0 00000100:00100000:0.0:1788940767.249289:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068551936 00000100:00100000:0.0:1788940767.249297:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068551936 00000100:00100000:0.0:1788940767.249340:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788940767.250901:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940767.250999:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068552192 00000100:00100000:1.0:1788940767.251007:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068552192 00000100:00100000:1.0:1788940767.251058:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788940767.251068:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068552192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940767.251132:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068552192:12345-0@lo:400:kworker.0 Request processed in 65us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940767.251139:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788940767.251201:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068552192:0@lo:400:kworker.0 00000100:00080000:1.0:1788940767.251237:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940767.251242:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940767.251245:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940767.251316:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068551936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940767.251375:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068551936:12345-0@lo:400:kworker.0 Request processed in 64us (7192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940767.252510:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068551936:0@lo:400:kworker.0 00000100:00100000:0.0:1788940767.263887:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788940767.264261:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068552064:12345-0@lo:400:kworker.0 Request processed in 22195us (22348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940767.264272:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788940767.264557:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f872680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068552064:0@lo:400:kworker.0 00000100:00100000:2.0:1788940767.264711:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940767.264841:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068552320:0@lo:400:kworker.0 00000100:00100000:2.0:1788940767.264888:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940767.265080:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068552320 00000100:00100000:0.0:1788940767.265088:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068552320 00000100:00100000:0.0:1788940767.265168:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788940767.265178:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068552320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940767.265255:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068552320:12345-0@lo:400:kworker.0 Request processed in 79us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940767.265263:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788940767.265331:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068552320:0@lo:400:kworker.0 00000100:00080000:3.0:1788940767.265774:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940767.265950:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068551808 00000100:00100000:1.0:1788940767.265956:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068551808 00000100:00100000:1.0:1788940767.266030:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788940767.266039:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068551808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940767.266109:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068551808:12345-0@lo:400:kworker.0 Request processed in 72us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940767.266116:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788940767.266213:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068551808:0@lo:400:kworker.0 00000100:00100000:2.0:1788940767.753657:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940767.753682:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f410f53ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068552576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940767.753773:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940767.753996:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068552576 00000100:00100000:3.0:1788940767.754005:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068552576 00000100:00100000:3.0:1788940767.754062:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788940767.754072:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068552576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940767.754108:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940767.754164:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068552576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940767.754171:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1788940767.756953:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f410f53ad80 x1875840068552576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940767.756982:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f410f53ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068552576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940767.817214:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940767.882767:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940767.882939:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036005632 00000100:00100000:0.0:1788940767.882950:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036005632 00000100:00100000:0.0:1788940767.883033:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 32 00000100:00100000:0.0:1788940767.883044:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:10241:x1875840036005632:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940767.883065:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940767.883103:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa2f0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22640d expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.883173:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2f12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.883221:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.883254:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940767.883295:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788940767.883299:0:7198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940767.883342:0:7198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2f12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.883367:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa2f0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22640d expref: 7 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.883386:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2f12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22640d expref: 6 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.883407:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f000) 00010000:00010000:0.0:1788940767.883410:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940767.883413:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234200, rc 0) 00000100:00100000:0.0:1788940767.883488:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:10241:x1875840036005632:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 446us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940767.883496:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 32 00000100:00080000:3.0:1788940767.884214:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940767.912927:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940767.913267:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036005760 00000100:00100000:0.0:1788940767.913284:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036005760 00000100:00100000:0.0:1788940767.913646:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 33 00000100:00100000:0.0:1788940767.913660:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:10242:x1875840036005760:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940767.913688:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940767.913717:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa2f19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226414 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.914087:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.914106:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.914119:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.914135:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.914143:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.914150:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.914965:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234a00/0xa1d8aa9164aa2f2e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.914982:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234a00/0xa1d8aa9164aa2f2e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.914991:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234a00/0xa1d8aa9164aa2f2e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940767.915030:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788940767.915035:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940767.915059:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234a00/0xa1d8aa9164aa2f2e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915085:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915093:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915100:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915107:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940767.915113:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915121:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915134:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f000) 00010000:00010000:0.0:1788940767.915137:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940767.915142:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915148:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915280:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915287:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915293:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915305:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940767.915308:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915314:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915323:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f410ad9f300) 00010000:00010000:0.0:1788940767.915326:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940767.915330:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915336:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915383:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa2f19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226414 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915399:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234a00/0xa1d8aa9164aa2f2e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226414 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.915406:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f410ad9f900) 00010000:00010000:0.0:1788940767.915409:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940767.915411:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234a00, rc 0) 00000100:00100000:0.0:1788940767.915612:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:10242:x1875840036005760:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 1950us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940767.915624:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 33 00000100:00100000:2.0:1788940767.954578:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940767.954653:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036006016 00000100:00100000:0.0:1788940767.954685:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036006016 00000100:00100000:0.0:1788940767.955011:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 34 00000100:00100000:0.0:1788940767.955026:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:10242:x1875840036006016:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940767.955055:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940767.955082:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa2f35 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22641b expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.955236:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f3c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.955255:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.955271:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.955454:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f43 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.955482:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.955495:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.955899:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234400/0xa1d8aa9164aa2f4a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.955910:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234400/0xa1d8aa9164aa2f4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.955919:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234400/0xa1d8aa9164aa2f4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940767.955942:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788940767.956095:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956104:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f3c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956111:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956118:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940767.956123:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956131:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f3c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956143:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f410ad9f900) 00010000:00010000:0.0:1788940767.956146:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940767.956151:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f3c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956157:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa2f3c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956170:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956176:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f43 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956261:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956267:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940767.956271:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956280:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f43 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956291:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f410ad9f300) 00010000:00010000:0.0:1788940767.956294:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940767.956299:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f43 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956305:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa2f43 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956809:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa2f35 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22641b expref: 10 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956827:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234400/0xa1d8aa9164aa2f4a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22641b expref: 9 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940767.956834:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9fd00) 00010000:00010000:0.0:1788940767.956836:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940767.956840:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234400, rc 0) 00000100:00100000:0.0:1788940767.956918:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:10242:x1875840036006016:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 1894us (2351us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788940767.956937:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 34 00000100:00100000:1.0:1788940767.968235:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940767.968356:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036006144 00000100:00100000:2.0:1788940767.968370:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036006144 00000100:00100000:2.0:1788940767.968463:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 35 00000100:00100000:2.0:1788940767.968477:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:10242:x1875840036006144:12345-192.168.202.17@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788940767.968639:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:10242:x1875840036006144:12345-192.168.202.17@tcp:59:lhsmtool_posix.0 Request processed in 163us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940767.968647:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 35 00000001:00080000:1.0:1788940768.354774:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000040:00080000:1.0:1788940768.650007:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788940768.840515:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940769.288861:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f410f538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068552704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940769.288976:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940769.289128:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068552704 00000100:00100000:3.0:1788940769.289141:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068552704 00000100:00100000:3.0:1788940769.289256:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788940769.289273:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068552704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940769.289323:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940769.289384:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068552704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940769.289405:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788940769.289505:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f410f538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068552704:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788940769.290603:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940769.458072:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940769.458119:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940769.458176:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940769.458239:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036006272 00000100:00100000:3.0:1788940769.458254:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036006272 00000100:00100000:3.0:1788940769.458324:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 293 00000100:00100000:3.0:1788940769.458336:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:2359:x1875840036006272:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940769.458619:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036006528 00000100:00100000:0.0:1788940769.458625:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036006528 00000100:00100000:0.0:1788940769.458678:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036006400 00000100:00100000:0.0:1788940769.458682:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036006400 00000100:00100000:0.0:1788940769.458703:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 146 00000100:00100000:0.0:1788940769.458711:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840036006528:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940769.464584:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:2359:x1875840036006272:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 6230us (6511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940769.464605:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 293 00000100:00100000:1.0:1788940769.465877:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 147 00000100:00100000:1.0:1788940769.465912:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2359:x1875840036006400:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940769.471601:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840036006528:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 12872us (13462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940769.471624:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 146 00000100:00080000:0.0:1788940769.471757:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940769.490976:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2359:x1875840036006400:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 25060us (32775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940769.491000:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 147 00010000:00010000:3.0:1788940769.864441:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940770.696838:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788940770.891151:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940771.200116:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940771.200241:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036006656 00000100:00100000:1.0:1788940771.200256:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036006656 00000100:00100000:1.0:1788940771.200335:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 36 00000100:00100000:1.0:1788940771.200347:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:10285:x1875840036006656:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:1.0:1788940771.200374:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940771.200403:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa2f58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226422 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.200503:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2f5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788940771.200626:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788940771.201039:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.201058:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.201077:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.201085:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.201092:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.201489:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2f5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.201500:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2f5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.201509:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2f5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.202444:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940771.202452:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2f5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.202463:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2f5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.202484:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f000) 00010000:00010000:1.0:1788940771.202499:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940771.202506:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2f5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.203453:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2f5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.203488:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.203496:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.203505:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.203830:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940771.203837:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.203847:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.203862:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f41129a4300) 00010000:00010000:1.0:1788940771.203866:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940771.203871:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.203877:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.203947:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa2f58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226422 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.203975:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f000) 00010000:00010000:1.0:1788940771.203978:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940771.203982:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa2f58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226422 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.203993:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4200, rc 0) 00000100:00100000:1.0:1788940771.204094:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:10285:x1875840036006656:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 3749us (3991us total) trans 0 rc 301/301 00000100:00100000:1.0:1788940771.204106:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 36 00000100:00100000:0.0:1788940771.229719:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940771.230027:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036006912 00000100:00100000:1.0:1788940771.230041:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036006912 00000100:00100000:1.0:1788940771.230123:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 37 00000100:00100000:1.0:1788940771.230136:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:10285:x1875840036006912:12345-192.168.202.17@tcp:36:lfs.0 00010000:00010000:1.0:1788940771.230240:0:7198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940771.230274:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa2f12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22640d expref: 8 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.230298:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f000) 00010000:00010000:1.0:1788940771.230311:0:7198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940771.230604:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa2f6d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.230622:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa2f6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.230635:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa2f6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.230662:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa2f74 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.230669:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa2f74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.230676:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa2f74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940771.252064:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788940771.252101:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa2f6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.252116:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa2f6d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.252126:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa2f6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.252135:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940771.252141:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa2f6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.252151:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa2f6d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.252178:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f41129a4d00) 00010000:00010000:1.0:1788940771.252182:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940771.252237:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa2f6d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.252261:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa2f6d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940771.252290:0:7198:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000591f29f8 reply state 00000000e96f378d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa2f74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940771.252302:0:7198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940771.252493:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:10285:x1875840036006912:12345-192.168.202.17@tcp:36:lfs.0 Request processed in 22350us (22781us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788940771.252507:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 37 00010000:00010000:0.0:1788940771.264341:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa2f74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.264368:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa2f74 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.264377:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa2f74 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.264385:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940771.264390:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa2f74 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.264400:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa2f74 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.264451:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f41129a4200) 00010000:00010000:0.0:1788940771.264475:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940771.264483:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa2f74 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.264490:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa2f74 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940771.417729:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940771.417946:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036007040 00000100:00100000:1.0:1788940771.417962:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036007040 00000100:00100000:1.0:1788940771.418039:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 38 00000100:00100000:1.0:1788940771.418052:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:10293:x1875840036007040:12345-192.168.202.17@tcp:101:lctl.0 00010000:00010000:1.0:1788940771.418086:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940771.418116:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa2f7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226429 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.418237:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.418255:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.418270:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940771.418315:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940771.418320:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940771.418391:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.418435:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa2f7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226429 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.418458:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226429 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.418467:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f41129a4d00) 00010000:00010000:1.0:1788940771.418470:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940771.418475:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4000, rc 0) 00000100:00100000:1.0:1788940771.418551:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:10293:x1875840036007040:12345-192.168.202.17@tcp:101:lctl.0 Request processed in 502us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940771.418559:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 38 00000100:00100000:1.0:1788940771.524909:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940771.525065:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036007168 00000100:00100000:2.0:1788940771.525081:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036007168 00000100:00100000:2.0:1788940771.525159:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 39 00000100:00100000:2.0:1788940771.525172:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:10299:x1875840036007168:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:2.0:1788940771.525220:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940771.525264:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2f89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226430 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525359:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2f90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525380:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2f90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525399:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2f90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525458:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa2f97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525466:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa2f97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525474:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa2f97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525629:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2f9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525639:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2f9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525646:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2f9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940771.525697:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788940771.525703:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940771.525881:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2f9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525907:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2f90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525915:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2f90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525922:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2f90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525929:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940771.525935:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2f90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525943:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2f90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525958:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f41129a4d00) 00010000:00010000:2.0:1788940771.525962:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940771.525967:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2f90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525974:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa2f90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525990:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa2f97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.525996:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa2f97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.526002:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa2f97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.526014:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940771.526017:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa2f97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.526023:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa2f97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.526031:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f41054d7700) 00010000:00010000:2.0:1788940771.526034:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940771.526037:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa2f97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.526043:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa2f97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.526081:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa2f89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226430 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.526097:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2f9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226430 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.526106:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:2.0:1788940771.526108:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788940771.526111:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6400, rc 0) 00000100:00100000:2.0:1788940771.526232:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:10299:x1875840036007168:12345-192.168.202.17@tcp:101:bash.0 Request processed in 1062us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940771.526241:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 39 00000100:00100000:1.0:1788940771.539928:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940771.539981:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036007424 00000100:00100000:1.0:1788940771.539996:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036007424 00000100:00100000:1.0:1788940771.540085:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 40 00000100:00100000:1.0:1788940771.540103:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:10299:x1875840036007424:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:1.0:1788940771.540133:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940771.540162:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa2fa5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226437 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.540370:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2fac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.540389:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2fac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.540432:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2fac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.540503:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa2fb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.540521:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa2fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.540529:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa2fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940771.541283:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788940771.541526:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa2fba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.541541:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa2fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.541552:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa2fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.541598:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2fac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.541607:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2fac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.541614:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2fac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.541621:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940771.541634:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2fac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.541644:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2fac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.541660:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:1.0:1788940771.541663:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940771.541669:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2fac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.541676:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa2fac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940771.541692:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b08a58d reply state 0000000001784e9e transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa2fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940771.541702:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788940771.541746:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa2fa5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226437 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.541763:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa2fba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226437 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.541770:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4200) 00010000:00010000:1.0:1788940771.541773:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940771.541776:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4400, rc 0) 00000100:00100000:1.0:1788940771.541870:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:10299:x1875840036007424:12345-192.168.202.17@tcp:101:bash.0 Request processed in 1773us (1958us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788940771.541880:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 40 00010000:00010000:0.0:1788940771.545010:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa2fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.545030:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa2fb3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.545037:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa2fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.545044:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940771.545048:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa2fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.545056:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa2fb3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940771.545075:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00010000:00010000:0.0:1788940771.545090:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f41129a4300) 00010000:00010000:0.0:1788940771.545095:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940771.545104:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa2fb3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.545110:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa2fb3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940771.545230:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036007552 00000100:00100000:3.0:1788940771.545245:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036007552 00000100:00100000:3.0:1788940771.545305:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 20 00000100:00100000:3.0:1788940771.545316:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875840036007552:12345-192.168.202.17@tcp:8:bash.0 00010000:00080000:3.0:1788940771.545360:0:8426:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:3.0:1788940771.545398:0:8426:0:(genops.c:1384:class_connect()) connect: client 9fbe6afa-4201-4af1-bbe2-c715064eeb39, cookie 0xa1d8aa9164aa2fc8 00002000:00100000:3.0:1788940771.545424:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9fbe6afa-4201-4af1-bbe2-c715064eeb39/ffff8f41184d7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788940771.545456:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788940771.545774:0:8426:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788940771.545813:0:8426:0:(import.c:65:import_set_state_nolock()) ffff8f41184d2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940771.545901:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2357:x1875840036007552:12345-192.168.202.17@tcp:8:bash.0 Request processed in 585us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940771.545910:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 20 00000100:00100000:1.0:1788940771.558849:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940771.558984:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036007680 00000100:00100000:3.0:1788940771.558998:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036007680 00000100:00080000:2.0:1788940771.559130:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940771.559182:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 21 00000100:00100000:3.0:1788940771.559230:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:0:x1875840036007680:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:3.0:1788940771.559257:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940771.559292:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ef92be9/0xa1d8aa9164aa2fcf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22643e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940771.559330:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788940771.559356:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=412s v=(0 0) 00010000:00010000:3.0:1788940771.559362:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940771.559374:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ef92be9/0xa1d8aa9164aa2fcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22643e expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.559399:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ef92be9/0xa1d8aa9164aa2fcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22643e expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.559427:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37e00, rc 0) 00000100:00100000:3.0:1788940771.559500:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:0:x1875840036007680:12345-192.168.202.17@tcp:101:bash.0 Request processed in 274us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940771.559519:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 21 00000100:00100000:1.0:1788940771.578070:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940771.578277:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036007808 00000100:00100000:0.0:1788940771.578310:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036007808 00000100:00100000:0.0:1788940771.578444:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 22 00000100:00100000:0.0:1788940771.578458:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:10299:x1875840036007808:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:0.0:1788940771.578484:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940771.578639:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226445 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.578685:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ef92be9/0xa1d8aa9164aa2fcf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22643e expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.578697:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940771.578714:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940771.578721:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.578767:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ef92be9/0xa1d8aa9164aa2fcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22643e expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.578784:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ef92be9/0xa1d8aa9164aa2fcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22643e expref: 8 pid: 6673 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940771.578803:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f873100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6674:1875840068552832:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940771.578918:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a5b8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788940771.587135:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940771.587302:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036007936 00000100:00100000:1.0:1788940771.587315:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036007936 00010000:00010000:1.0:1788940771.587369:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ef92be9/0xa1d8aa9164aa2fcf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22643e expref: 9 pid: 6673 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940771.587431:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 35 00000100:00100000:1.0:1788940771.587444:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2359:x1875840036007936:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940771.587466:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940771.587497:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ef92be9/0xa1d8aa9164aa2fcf lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22643e expref: 9 pid: 6673 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.587523:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ef92be9/0xa1d8aa9164aa2fcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22643e expref: 9 pid: 6673 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.587559:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940771.587564:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940771.587575:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 9 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.587587:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 9 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.587638:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 9 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940771.587682:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111299c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5819:1875840068552960:192.168.202.17@tcp:105: 00000100:00100000:1.0:1788940771.587800:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114fee40 going to sleep for 11 seconds 00010000:00010000:3.0:1788940771.588268:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ef92be9/0xa1d8aa9164aa2fcf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22643e expref: 9 pid: 6673 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940771.588299:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f873100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6674:1875840068552832:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940771.588331:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.588343:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235e00, rc 0) 00000100:00100000:3.0:1788940771.588470:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:10299:x1875840036007808:12345-192.168.202.17@tcp:101:bash.0 Request processed in 10015us (10417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940771.588481:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 22 00000100:00100000:3.0:1788940771.591664:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111299c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5819:1875840068552960:192.168.202.17@tcp:105: 00010000:00010000:3.0:1788940771.591772:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940771.591940:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036007936:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 4497us (4818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940771.591953:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 35 00000100:00100000:2.0:1788940771.606604:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940771.606843:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036008192 00000100:00100000:3.0:1788940771.606857:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036008192 00000100:00100000:3.0:1788940771.606929:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00100000:3.0:1788940771.606941:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+12:10299:x1875840036008192:12345-192.168.202.17@tcp:35:bash.0 00000100:00100000:3.0:1788940771.607526:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:10299:x1875840036008192:12345-192.168.202.17@tcp:35:bash.0 Request processed in 585us (935us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788940771.607537:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00100000:1.0:1788940771.744930:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940771.745055:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036008448 00000100:00100000:2.0:1788940771.745069:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036008448 00000100:00100000:2.0:1788940771.745158:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 41 00000100:00100000:2.0:1788940771.745170:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:10309:x1875840036008448:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940771.745241:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940771.745268:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2fdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22644c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940771.745390:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788940771.745570:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2fdd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22644c expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.745588:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f41129a4d00) 00010000:00010000:2.0:1788940771.745592:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940771.745598:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2fdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22644c expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.745617:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6a00, rc 0) 00000100:00100000:2.0:1788940771.745704:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:10309:x1875840036008448:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 535us (788us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788940771.745713:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 41 00000100:00100000:1.0:1788940771.750344:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940771.750437:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036008704 00000100:00100000:3.0:1788940771.750454:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036008704 00000100:00100000:3.0:1788940771.750541:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:3.0:1788940771.750556:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:10309:x1875840036008704:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:3.0:1788940771.750935:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:10309:x1875840036008704:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 381us (604us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788940771.750944:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:3.0:1788940771.844825:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940771.847084:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036008832 00000100:00100000:1.0:1788940771.847107:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036008832 00000100:00100000:1.0:1788940771.847227:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 42 00000100:00100000:1.0:1788940771.847240:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:10315:x1875840036008832:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:1.0:1788940771.847273:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940771.847302:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa2feb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226453 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.847391:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa2ff2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.847417:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa2ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.847435:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa2ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940771.847480:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788940771.847483:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940771.847506:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa2ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.847537:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa2feb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226453 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.847587:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa2ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226453 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.847596:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:1.0:1788940771.847599:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940771.847604:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4e00, rc 0) 00000100:00100000:1.0:1788940771.848097:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:10315:x1875840036008832:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 857us (3346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940771.848106:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 42 00000100:00100000:1.0:1788940771.858026:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940771.862280:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036009088 00000100:00100000:2.0:1788940771.862417:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036009088 00000100:00100000:2.0:1788940771.863600:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 43 00000100:00100000:2.0:1788940771.863626:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:10315:x1875840036009088:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940771.863675:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940771.863717:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2ff9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22645a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.863878:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3000 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.863896:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.863912:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940771.863928:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788940771.864114:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa2ff9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22645a expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.864138:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3000 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22645a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.864147:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4200) 00010000:00010000:2.0:1788940771.864151:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940771.864155:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7200, rc 0) 00000100:00100000:2.0:1788940771.864308:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:10315:x1875840036009088:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 693us (6297us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788940771.864317:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 43 00000100:00100000:3.0:1788940771.872349:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940771.877096:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940771.877139:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036009472 00000100:00100000:3.0:1788940771.877153:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036009472 00000100:00100000:3.0:1788940771.877261:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 2 00000100:00100000:3.0:1788940771.877273:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:2360:x1875840036009472:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940771.877298:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940771.877334:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3000 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22645a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.877360:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4200) 00010000:00010000:3.0:1788940771.877367:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940771.877450:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:2360:x1875840036009472:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 179us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940771.877461:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 2 00000100:00100000:1.0:1788940771.878476:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036009344 00000100:00100000:1.0:1788940771.878960:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036009344 00000100:00100000:1.0:1788940771.879054:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 44 00000100:00100000:1.0:1788940771.879067:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:10315:x1875840036009344:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:1.0:1788940771.879100:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940771.879126:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa300e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226461 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.879483:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa3015 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.880331:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa3015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.880349:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa3015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940771.880395:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788940771.882149:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa300e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226461 expref: 20 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.882219:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa3015 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226461 expref: 19 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.882232:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4200) 00010000:00010000:1.0:1788940771.882235:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788940771.882240:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5400, rc 0) 00000100:00100000:1.0:1788940771.882335:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:10315:x1875840036009344:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 3271us (10002us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788940771.882346:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 44 00000100:00100000:3.0:1788940771.896176:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940771.897291:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036009600 00000100:00100000:1.0:1788940771.897309:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036009600 00000100:00100000:1.0:1788940771.897385:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 23 00000100:00100000:1.0:1788940771.897398:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036009600:12345-192.168.202.17@tcp:1:lfs.0 00010000:00010000:1.0:1788940771.897474:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d525e729/0xa1d8aa9164aa3023 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.897502:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.897512:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788940771.897518:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940771.897523:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d525e729/0xa1d8aa9164aa3023 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.897591:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.897608:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 7 pid: 6674 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940771.897628:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41012af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1875840068553088:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940771.899224:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114fe300 going to sleep for 11 seconds 00000100:00100000:1.0:1788940771.901627:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41012af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1875840068553088:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940771.901675:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d525e729/0xa1d8aa9164aa3023 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940771.907989:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940771.908313:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036009728 00000100:00100000:3.0:1788940771.908328:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036009728 00002000:00100000:3.0:1788940771.908398:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8f413f367480 x1875840036009728/t0(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:747/0 lens 504/0 e 0 to 0 dl 1788940782 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940771.908423:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f413f367480 with x1875840036009728 ext(0->12) 00010000:00010000:3.0:1788940771.908435:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 8 pid: 6674 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.908474:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 8 pid: 6674 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940771.908484:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f413f367480 00000100:00100000:3.0:1788940771.908527:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:3.0:1788940771.908539:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2359:x1875840036009728:12345-192.168.202.17@tcp:4:lfs.0 00010000:00010000:3.0:1788940771.912439:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788940771.947956:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000100:00100000:3.0:1788940771.948817:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2359:x1875840036009728:12345-192.168.202.17@tcp:4:lfs.0 Request processed in 40273us (40837us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788940771.948831:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 0 00002000:00100000:3.0:1788940771.948848:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8f413f367480 x1875840036009728/t4294967299(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:747/0 lens 504/448 e 0 to 0 dl 1788940782 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940771.948859:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f413f367480 with x1875840036009728 ext(0->12) 00010000:00010000:3.0:1788940771.948870:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 9 pid: 6674 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.948892:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 9 pid: 6674 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940771.948902:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f413f367480 00000100:00100000:3.0:1788940771.951820:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940771.952062:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036009856 00000100:00100000:2.0:1788940771.952077:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036009856 00010000:00010000:2.0:1788940771.952146:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 9 pid: 6674 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940771.952231:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 36 00000100:00100000:2.0:1788940771.952245:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2358:x1875840036009856:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940771.952270:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788940771.952298:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788940771.952302:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788940770 00002000:00010000:2.0:1788940771.952305:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788940770 00002000:00010000:2.0:1788940771.952307:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788940770 00010000:00010000:2.0:1788940771.952314:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 9 pid: 6674 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.952331:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 9 pid: 6674 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.952361:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066b7a420/0xa1d8aa9164aa2fd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226445 expref: 9 pid: 6674 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.952397:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940771.952412:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940771.952420:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d525e729/0xa1d8aa9164aa3023 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.952432:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d525e729/0xa1d8aa9164aa3023 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.952484:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940771.952548:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d525e729/0xa1d8aa9164aa3023 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940771.952574:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2358:x1875840036009856:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 329us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940771.952602:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 36 00010000:00010000:1.0:1788940771.952603:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d525e729/0xa1d8aa9164aa3023 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.952649:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d525e729/0xa1d8aa9164aa3023 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.952660:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d525e729/0xa1d8aa9164aa3023 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.952698:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d525e729/0xa1d8aa9164aa3023 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.952706:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4a00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940771.952711:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d525e729/0xa1d8aa9164aa3023 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.952720:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d525e729/0xa1d8aa9164aa3023 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.952741:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d525e729/0xa1d8aa9164aa3023 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940771.952750:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d525e729/0xa1d8aa9164aa3023 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940771.952852:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036009600:12345-192.168.202.17@tcp:1:lfs.0 Request processed in 55451us (56687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940771.952861:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 23 00000100:00100000:2.0:1788940771.962010:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940771.962231:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036010112 00000100:00100000:0.0:1788940771.962246:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036010112 00000100:00100000:0.0:1788940771.962334:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 8 00000100:00100000:0.0:1788940771.962348:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:10315:x1875840036010112:12345-192.168.202.17@tcp:35:lfs.0 00000004:00010000:0.0:1788940771.962454:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa3015 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226461 expref: 19 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940771.963513:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788940771.963597:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788940771.965318:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788940771.966829:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.966861:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa2fba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226437 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.966872:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.966928:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa2fba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226437 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.966950:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa2fba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226437 expref: 23 pid: 5833 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940771.966968:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f872680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1875840068553216:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940771.967113:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4102c580c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940771.975039:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940771.975937:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f872680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1875840068553216:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940771.975976:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940771.978319:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036010240 00000100:00100000:3.0:1788940771.978340:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036010240 00010000:00010000:3.0:1788940771.978479:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa2fba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226437 expref: 24 pid: 5833 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940771.978631:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 37 00000100:00100000:3.0:1788940771.978644:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:2358:x1875840036010240:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940771.978667:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940771.978676:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa2fba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226437 expref: 24 pid: 5833 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.978702:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa2fba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226437 expref: 24 pid: 5833 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.978898:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa2fba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226437 expref: 24 pid: 5833 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.978921:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4200) 00010000:00010000:3.0:1788940771.978928:0:7622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.978940:0:7622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.978949:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.978982:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940771.979180:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:2358:x1875840036010240:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 538us (4157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940771.979228:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 37 00010000:00010000:0.0:1788940771.979307:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940771.979330:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940771.979522:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788940771.979817:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788940771.979968:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f872300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875840068553344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788940771.980340:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940771.980398:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068553344 00000100:00100000:0.0:1788940771.980415:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068553344 00000100:00100000:0.0:1788940771.980477:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940771.980487:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875840068553344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788940771.980576:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875840068553344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940771.980584:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788940771.980614:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940771.980628:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4102c58840 going to sleep for 11 seconds 00000100:00100000:0.0:1788940771.980661:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f872300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875840068553344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788940771.982038:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788940771.982146:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41012af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875840068553472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788940771.982253:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940771.982298:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114fe540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940771.982314:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068553472 00000100:00100000:0.0:1788940771.982326:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068553472 00000100:00100000:0.0:1788940771.982499:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940771.982511:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875840068553472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788940771.983077:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875840068553472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 566us (823us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788940771.983087:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940771.983328:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41012af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875840068553472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788940771.983427:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788940771.983485:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.983499:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.983509:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.983517:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940771.983522:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.983532:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.983552:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4200) 00010000:00010000:2.0:1788940771.983563:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788940771.983570:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940771.983577:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa302a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940771.983947:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788940771.984592:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788940771.984610:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 413288422072ns, next at 414288418889ns, rc = 0 00000001:00080000:2.0:1788940771.984621:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788940771.984673:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4200) 00010000:00010000:2.0:1788940771.984677:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788940771.984687:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa3015 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226461 expref: 27 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940771.985085:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10315:x1875840036010112:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 22738us (23089us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788940771.985097:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 8 00000020:00080000:2.0:1788940771.985103:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788940771.992176:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940771.992338:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036010368 00000100:00100000:3.0:1788940771.992373:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036010368 00000100:00100000:3.0:1788940771.992504:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 45 00000100:00100000:3.0:1788940771.992518:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10315:x1875840036010368:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:3.0:1788940771.992553:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940771.992598:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3031 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226468 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.992723:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3031 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226468 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.992744:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3031 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226468 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940771.992779:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:3.0:1788940771.992783:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940771.992788:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36000, rc 0) 00000100:00100000:3.0:1788940771.992866:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10315:x1875840036010368:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 351us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940771.992873:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 45 00000100:00100000:1.0:1788940772.004540:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940772.004643:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036010624 00000100:00100000:3.0:1788940772.004660:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036010624 00000100:00100000:3.0:1788940772.004948:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00100000:3.0:1788940772.004961:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41057c5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10315:x1875840036010624:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:3.0:1788940772.005303:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41057c5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:10315:x1875840036010624:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 344us (776us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788940772.005312:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00100000:1.0:1788940772.134965:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940772.135116:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036010880 00000100:00100000:2.0:1788940772.135130:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036010880 00000100:00100000:2.0:1788940772.135235:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 46 00000100:00100000:2.0:1788940772.135249:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:10324:x1875840036010880:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940772.135282:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940772.135310:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3038 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22646f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940772.135440:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788940772.135607:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3038 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22646f expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.135625:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f41129a4d00) 00010000:00010000:2.0:1788940772.135628:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940772.135634:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3038 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22646f expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.135666:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6600, rc 0) 00000100:00100000:2.0:1788940772.135752:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+29:10324:x1875840036010880:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 506us (803us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788940772.135759:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 46 00000100:00100000:0.0:1788940772.143989:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940772.148270:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036011008 00000100:00100000:3.0:1788940772.148319:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036011008 00000100:00100000:3.0:1788940772.148514:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 47 00000100:00100000:3.0:1788940772.148529:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+29:10324:x1875840036011008:12345-192.168.202.17@tcp:34:lfs.0 00010000:00010000:3.0:1788940772.148635:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3046 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.148658:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3046 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.148672:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3046 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.148702:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa304d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.148717:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa304d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.148726:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa304d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.148852:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3054 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.148862:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.148870:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940772.148923:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.148951:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3046 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.148960:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3046 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.148968:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3046 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.148975:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940772.148981:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3046 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.148989:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3046 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149003:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:3.0:1788940772.149007:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940772.149013:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3046 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149020:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3046 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149037:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa304d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149044:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa304d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149050:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa304d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149061:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940772.149064:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa304d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149071:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa304d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149079:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4112cbf300) 00010000:00010000:3.0:1788940772.149083:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940772.149085:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa304d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149103:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa304d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149121:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149128:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3054 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149134:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3054 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149139:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940772.149142:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3054 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149148:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3054 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149166:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:3.0:1788940772.149168:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940772.149171:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3054 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940772.149177:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3054 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940772.149337:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+29:10324:x1875840036011008:12345-192.168.202.17@tcp:34:lfs.0 Request processed in 809us (5361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940772.149346:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 47 00000100:00100000:1.0:1788940772.163217:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940772.163844:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036011264 00000100:00100000:2.0:1788940772.163858:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036011264 00000100:00100000:2.0:1788940772.164000:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:2.0:1788940772.164013:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+29:10324:x1875840036011264:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:2.0:1788940772.165606:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+30:10324:x1875840036011264:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 1582us (2410us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788940772.165620:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:0.0:1788940772.248818:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940772.248929:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036011520 00000100:00100000:2.0:1788940772.248943:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036011520 00000100:00100000:2.0:1788940772.249022:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 48 00000100:00100000:2.0:1788940772.249034:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+30:10328:x1875840036011520:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940772.249071:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940772.249111:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa305b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226476 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249297:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3062 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249316:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249331:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249347:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3069 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249354:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249360:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249522:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249531:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249538:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940772.249550:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788940772.249674:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249683:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3062 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249698:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249706:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940772.249710:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249719:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3062 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249735:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:2.0:1788940772.249739:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940772.249744:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249754:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249769:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249775:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3069 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249780:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249786:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940772.249789:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249803:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3069 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249810:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f41054d7800) 00010000:00010000:2.0:1788940772.249812:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940772.249814:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3069 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249820:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3069 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249871:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa305b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226476 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249885:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226476 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.249891:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:2.0:1788940772.249893:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940772.249896:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6e00, rc 0) 00000100:00100000:2.0:1788940772.249992:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:10328:x1875840036011520:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 960us (1190us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788940772.250000:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 48 00000100:00100000:0.0:1788940772.260993:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940772.261234:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036011648 00000100:00100000:1.0:1788940772.261249:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036011648 00000100:00100000:1.0:1788940772.261328:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 49 00000100:00100000:1.0:1788940772.261341:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:10328:x1875840036011648:12345-192.168.202.17@tcp:54:lfs.0 00010000:00010000:1.0:1788940772.261444:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa307e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940772.261466:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa307e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940772.261480:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa307e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940772.261516:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa307e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940772.261524:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa307e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940772.261531:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa307e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940772.261538:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940772.261542:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa307e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940772.261551:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa307e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940772.261565:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:1.0:1788940772.261568:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940772.261583:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa307e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940772.261590:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa307e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940772.261691:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:10328:x1875840036011648:12345-192.168.202.17@tcp:54:lfs.0 Request processed in 351us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940772.261700:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 49 00000100:00100000:3.0:1788940772.275328:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940772.275574:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036011904 00000100:00100000:0.0:1788940772.275591:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036011904 00000100:00100000:0.0:1788940772.275683:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:0.0:1788940772.275697:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:10328:x1875840036011904:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:0.0:1788940772.276409:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+33:10328:x1875840036011904:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 701us (1087us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788940772.276420:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:0.0:1788940772.360695:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068553728:0@lo:400:kworker.0 00000100:00100000:0.0:1788940772.360803:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940772.360892:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940772.360899:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068553856:0@lo:400:kworker.0 00000100:00100000:0.0:1788940772.360927:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940772.360974:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068553728 00000100:00100000:0.0:1788940772.360984:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068553728 00000100:00100000:0.0:1788940772.361041:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068553856 00000100:00100000:0.0:1788940772.361045:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068553856 00000100:00080000:0.0:1788940772.361072:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940772.361109:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788940772.361121:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068553728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940772.361216:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068553728:12345-0@lo:400:kworker.0 Request processed in 68us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940772.361225:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788940772.361248:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788940772.361255:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068553856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940772.361282:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068553856:12345-0@lo:400:kworker.0 Request processed in 28us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940772.361299:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788940772.361343:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068553856:0@lo:400:kworker.0 00000100:00100000:0.0:1788940772.361356:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068553728:0@lo:400:kworker.0 00000100:00100000:3.0:1788940772.361481:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068553984:0@lo:400:kworker.0 00000100:00100000:3.0:1788940772.361522:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940772.361558:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788940772.361565:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068553600:0@lo:400:kworker.0 00000100:00100000:3.0:1788940772.361600:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940772.361623:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068554112:0@lo:400:kworker.0 00000100:00100000:3.0:1788940772.361646:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940772.362075:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068553984 00000100:00100000:0.0:1788940772.362083:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068553984 00000100:00100000:0.0:1788940772.362159:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788940772.362169:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068553984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940772.362257:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068553984:12345-0@lo:400:kworker.0 Request processed in 89us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940772.362264:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788940772.362299:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068553984:0@lo:400:kworker.0 00000100:00100000:0.0:1788940772.362320:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068554112 00000100:00100000:0.0:1788940772.362324:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068554112 00000100:00100000:0.0:1788940772.362351:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788940772.362358:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068554112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940772.362391:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068554112:12345-0@lo:400:kworker.0 Request processed in 34us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940772.362408:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788940772.362432:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068554112:0@lo:400:kworker.0 00000100:00080000:3.0:1788940772.363029:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940772.363037:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940772.363975:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068553600 00000100:00100000:1.0:1788940772.363989:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068553600 00000100:00100000:1.0:1788940772.364058:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788940772.364068:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068553600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940772.364149:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068553600:12345-0@lo:400:kworker.0 Request processed in 82us (2547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940772.364156:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788940772.364504:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068553600:0@lo:400:kworker.0 00000100:00100000:0.0:1788940772.874062:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41012ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068554240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940772.874164:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940772.874506:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068554240 00000100:00100000:3.0:1788940772.874517:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068554240 00000100:00100000:3.0:1788940772.874587:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788940772.874599:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875840068554240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940772.874652:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940772.874725:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875840068554240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940772.874762:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788940772.875753:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41012ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068554240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940772.885266:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940772.885359:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036012160 00000100:00100000:2.0:1788940772.885373:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036012160 00000100:00100000:2.0:1788940772.885447:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 50 00000100:00100000:2.0:1788940772.885458:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+33:10359:x1875840036012160:12345-192.168.202.17@tcp:101:cat.0 00010000:00010000:2.0:1788940772.885520:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940772.885547:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3085 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22647d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.885681:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa308c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.885701:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa308c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.885731:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa308c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940772.885960:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788940772.886143:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3085 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22647d expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.886165:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa308c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22647d expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.886175:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:2.0:1788940772.886179:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940772.886183:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7000, rc 0) 00000100:00100000:2.0:1788940772.886478:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:10359:x1875840036012160:12345-192.168.202.17@tcp:101:cat.0 Request processed in 1020us (1224us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788940772.886486:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 50 00000100:00100000:3.0:1788940772.893120:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940772.893439:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036012288 00000100:00100000:2.0:1788940772.893454:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036012288 00000100:00100000:2.0:1788940772.893553:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 3 00000100:00100000:2.0:1788940772.893585:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41080e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:2358:x1875840036012288:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940772.893607:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940772.893642:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa308c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22647d expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940772.893671:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:2.0:1788940772.893677:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940772.893966:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41080e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+34:2358:x1875840036012288:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 382us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940772.893974:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 3 00000100:00100000:0.0:1788940772.897385:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940772.897482:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036012544 00000100:00100000:2.0:1788940772.897504:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036012544 00000100:00100000:2.0:1788940772.897582:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00100000:2.0:1788940772.897594:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+34:10359:x1875840036012544:12345-192.168.202.17@tcp:35:cat.0 00000100:00100000:2.0:1788940772.898517:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:10359:x1875840036012544:12345-192.168.202.17@tcp:35:cat.0 Request processed in 917us (1139us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788940772.898531:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 12 00010000:00010000:3.0:1788940772.936530:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940773.007111:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940773.007229:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036012800 00000100:00100000:1.0:1788940773.007243:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036012800 00000100:00100000:1.0:1788940773.007348:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 51 00000100:00100000:1.0:1788940773.007361:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:10365:x1875840036012800:12345-192.168.202.17@tcp:101:dd.0 00010000:00010000:1.0:1788940773.007412:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940773.007417:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788940773.007457:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa2ff2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226453 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.007487:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:1.0:1788940773.007495:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940773.007516:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa309a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226484 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.007681:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.007699:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3070 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226476 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.007722:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.007777:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226476 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.007794:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226476 expref: 35 pid: 5835 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940773.007809:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41012ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875840068554368:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940773.007937:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114fec00 going to sleep for 11 seconds 00000100:00080000:3.0:1788940773.008687:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940773.014143:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41012ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875840068554368:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940773.014218:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940773.025562:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940773.025853:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036012928 00000100:00100000:2.0:1788940773.025867:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036012928 00010000:00010000:2.0:1788940773.025926:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226476 expref: 36 pid: 5835 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940773.025972:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 38 00000100:00100000:2.0:1788940773.025983:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+36:2359:x1875840036012928:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940773.026004:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940773.026012:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226476 expref: 36 pid: 5835 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.026047:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226476 expref: 36 pid: 5835 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.026077:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226476 expref: 36 pid: 5835 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.026099:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:2.0:1788940773.026105:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.026117:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.026126:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.026168:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940773.026300:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:2359:x1875840036012928:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 318us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940773.026308:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 38 00010000:00010000:1.0:1788940773.026401:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.026410:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940773.026435:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788940773.026691:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa309a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226484 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.026713:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226484 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.026721:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:1.0:1788940773.026724:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788940773.026727:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5800, rc 0) 00000100:00100000:1.0:1788940773.026771:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:10365:x1875840036012800:12345-192.168.202.17@tcp:101:dd.0 Request processed in 19413us (19675us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788940773.026780:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 51 00000100:00100000:3.0:1788940773.033430:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940773.033545:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036013184 00000100:00100000:0.0:1788940773.033560:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036013184 00000100:00100000:0.0:1788940773.033640:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 52 00000100:00100000:0.0:1788940773.033653:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:10365:x1875840036013184:12345-192.168.202.17@tcp:36:dd.0 00010000:00010000:0.0:1788940773.034297:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa30af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.034321:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa30af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.034335:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa30af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940773.034407:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788940773.034436:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001166c6a3 reply state 0000000090f32bcf transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa30af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940773.034447:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940773.034636:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+38:10365:x1875840036013184:12345-192.168.202.17@tcp:36:dd.0 Request processed in 983us (1220us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788940773.034645:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 52 00000020:00080000:0.0:1788940773.034652:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788940773.048468:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa30af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.048497:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa30af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.048506:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa30af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.048538:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940773.048544:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa30af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.048553:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa30af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.048577:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:2.0:1788940773.048580:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940773.048587:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa30af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.048594:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa30af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940773.378064:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940773.378259:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036013312 00000100:00100000:2.0:1788940773.378274:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036013312 00000100:00100000:2.0:1788940773.378443:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 53 00000100:00100000:2.0:1788940773.378458:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+37:10379:x1875840036013312:12345-192.168.202.17@tcp:101:stat.0 00010000:00010000:2.0:1788940773.378497:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940773.378531:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa30b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22648b expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.378645:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa30bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.378667:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa30bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.378682:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa30bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.379107:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa30c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.379117:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa30c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.379125:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa30c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.379302:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.379316:0:7198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226484 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.379326:0:7198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30cb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.379393:0:7198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226484 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.379411:0:7198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226484 expref: 38 pid: 5833 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940773.379430:0:7198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f367b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068554496:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940773.380254:0:7198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410f6b40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940773.399349:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940773.399445:0:7198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f367b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068554496:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940773.399483:0:7198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940773.399520:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036013568 00000100:00100000:3.0:1788940773.399529:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036013568 00000100:00100000:3.0:1788940773.399609:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00100000:3.0:1788940773.399621:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+39:5602:x1875840036013568:12345-192.168.202.17@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788940773.400296:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+40:5602:x1875840036013568:12345-192.168.202.17@tcp:35:ldlm_bl.0 Request processed in 672us (961us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788940773.400308:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00100000:0.0:1788940773.407681:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940773.408029:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036013696 00000100:00100000:0.0:1788940773.408045:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036013696 00010000:00010000:0.0:1788940773.408108:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226484 expref: 40 pid: 5833 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940773.408176:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 39 00000100:00100000:0.0:1788940773.408220:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+40:2358:x1875840036013696:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940773.408242:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940773.408251:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226484 expref: 40 pid: 5833 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.408265:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226484 expref: 40 pid: 5833 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.408296:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa30a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226484 expref: 40 pid: 5833 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.408316:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:0.0:1788940773.408323:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.408336:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.408345:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30cb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.408400:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940773.408477:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+39:2358:x1875840036013696:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 290us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940773.408486:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 39 00010000:00010000:3.0:1788940773.410464:0:7198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.410484:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940773.410566:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788940773.410572:0:7198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940773.410640:0:7198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.410676:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.410690:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa30bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.410697:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa30bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.410717:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa30bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.410724:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940773.410729:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa30bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.410737:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa30bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.413275:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:3.0:1788940773.413290:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940773.413302:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa30bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.413315:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa30bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.413349:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa30c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.414651:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa30c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.414685:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa30c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.414693:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940773.416802:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa30c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.416836:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa30c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.416861:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f41054d7800) 00010000:00010000:3.0:1788940773.416865:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940773.416872:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa30c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.416881:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa30c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.416964:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa30b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22648b expref: 39 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.416982:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22648b expref: 38 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.416992:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:3.0:1788940773.416995:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940773.416998:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6c00, rc 0) 00000100:00100000:3.0:1788940773.417086:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+38:10379:x1875840036013312:12345-192.168.202.17@tcp:101:stat.0 Request processed in 38629us (39036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940773.417112:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 53 00000001:00080000:1.0:1788940773.492794:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000020:00080000:1.0:1788940773.492843:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f4102c58840 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788940773.492849:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f4134e72e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f4102c58240 00000020:00080000:1.0:1788940773.492853:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f4134e72c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f41370ea400 00000004:00080000:1.0:1788940773.492893:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788940773.492965:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788940773.493105:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788940773.493380:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940773.493666:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068554624:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788940773.493842:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940773.494063:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068554624 00000100:00100000:3.0:1788940773.494073:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068554624 00000100:00100000:3.0:1788940773.494184:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940773.494229:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875840068554624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788940773.494261:0:6673:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788940773.494308:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa111e2, atime: 0x6aa111e2, ctime: 0x6aa111e2, blocks: 0x1 00010000:00010000:3.0:1788940773.494319:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5877670/0xa1d8aa9164aa30d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.494340:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1788940773.494346:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940773.494354:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5877670/0xa1d8aa9164aa30d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.494465:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5877670/0xa1d8aa9164aa30d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.494478:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5877670/0xa1d8aa9164aa30d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.494486:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5877670/0xa1d8aa9164aa30d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.494533:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788940773.495239:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1875840068554624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1011us (1393us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788940773.495251:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:3.0:1788940773.495325:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f413f367800/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788940773.495332:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068554624:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788940773.495720:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940773.495732:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5877670/0xa1d8aa9164aa30d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.495769:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36600 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940773.495776:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5877670/0xa1d8aa9164aa30d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.495788:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5877670/0xa1d8aa9164aa30d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.495813:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5877670/0xa1d8aa9164aa30d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.495821:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5877670/0xa1d8aa9164aa30d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.495846:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940773.495848:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940773.495850:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940773.496175:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940773.560420:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940773.562741:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036013952 00000100:00100000:2.0:1788940773.562762:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036013952 00000100:00100000:2.0:1788940773.562863:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 54 00000100:00100000:2.0:1788940773.562877:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+12:10385:x1875840036013952:12345-192.168.202.17@tcp:36:truncate.0 00010000:00010000:2.0:1788940773.562956:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940773.563272:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22648b expref: 12 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.563300:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:2.0:1788940773.563324:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940773.564230:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa30d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.564253:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa30d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940773.564266:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa30d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940773.564341:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788940773.564374:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2cec372 reply state 000000009a046237 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa30d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940773.564393:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940773.564621:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:10385:x1875840036013952:12345-192.168.202.17@tcp:36:truncate.0 Request processed in 1743us (4213us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788940773.564630:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 54 00000020:00080000:3.0:1788940773.564637:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788940773.571860:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa30d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.571886:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa30d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.571894:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa30d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.571902:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940773.571907:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa30d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.571916:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa30d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.571935:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:0.0:1788940773.571939:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940773.571945:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa30d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940773.571951:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa30d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940773.883884:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940773.891921:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036014080 00000100:00100000:1.0:1788940773.891944:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036014080 00000100:00100000:1.0:1788940773.892053:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 55 00000100:00100000:1.0:1788940773.892067:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:10399:x1875840036014080:12345-192.168.202.17@tcp:101:stat.0 00010000:00010000:1.0:1788940773.892101:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940773.892128:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa30e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226492 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.892270:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa30e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.892287:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa30e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.892304:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa30e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.892322:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa30ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.892329:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa30ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940773.892336:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa30ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.895945:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.895972:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.895989:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940773.896155:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788940773.896161:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940773.896253:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.896271:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.896283:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa30e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.896292:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa30e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.896301:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa30e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.896309:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940773.896314:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa30e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.896324:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa30e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.896525:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:2.0:1788940773.896530:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940773.896536:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa30e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.896919:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa30e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.896944:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa30ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.896952:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa30ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.896960:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa30ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.896967:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940773.896970:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa30ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.896978:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa30ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.896988:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f41129a4800) 00010000:00010000:2.0:1788940773.896990:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940773.897164:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa30ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.897173:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa30ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.897293:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa30e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226492 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.897313:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226492 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940773.897323:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:2.0:1788940773.897326:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940773.897330:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6c00, rc 0) 00000100:00100000:2.0:1788940773.897921:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:10399:x1875840036014080:12345-192.168.202.17@tcp:101:stat.0 Request processed in 5852us (14053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940773.897934:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 55 00010000:00010000:3.0:1788940773.962587:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940774.092315:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940774.092539:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036014336 00000100:00100000:1.0:1788940774.092562:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036014336 00000100:00100000:1.0:1788940774.092640:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 56 00000100:00100000:1.0:1788940774.092654:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:10409:x1875840036014336:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:1.0:1788940774.092684:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940774.092724:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa30fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226499 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940774.092859:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788940774.093236:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa30fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226499 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.093268:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f41129a4d00) 00010000:00010000:1.0:1788940774.093271:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940774.093278:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa30fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226499 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.093295:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5a00, rc 0) 00000100:00100000:1.0:1788940774.093453:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:10409:x1875840036014336:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 802us (1153us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788940774.093462:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 56 00000100:00100000:0.0:1788940774.113814:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940774.114107:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036014592 00000100:00100000:3.0:1788940774.114120:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036014592 00000100:00100000:3.0:1788940774.114228:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 14 00000100:00100000:3.0:1788940774.114241:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:10409:x1875840036014592:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:3.0:1788940774.114603:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:10409:x1875840036014592:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 363us (804us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788940774.114612:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 14 00000100:00100000:2.0:1788940774.257811:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940774.258172:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036014848 00000100:00100000:3.0:1788940774.258217:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036014848 00000100:00100000:3.0:1788940774.258304:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 57 00000100:00100000:3.0:1788940774.258316:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:10415:x1875840036014848:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:3.0:1788940774.258352:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940774.258393:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa310a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2264a0 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.258561:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.258584:0:7198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226492 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.258593:0:7198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.258643:0:7198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226492 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.258673:0:7198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226492 expref: 17 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940774.258712:0:7198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f410121b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068554752:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940774.258982:0:7198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a62be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940774.262345:0:7198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f410121b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068554752:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940774.262410:0:7198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940774.272338:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940774.273244:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036014976 00000100:00100000:3.0:1788940774.273260:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036014976 00010000:00010000:3.0:1788940774.273321:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226492 expref: 18 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940774.273372:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 40 00000100:00100000:3.0:1788940774.273392:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f365c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:2359:x1875840036014976:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940774.273411:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940774.273419:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226492 expref: 18 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.273435:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226492 expref: 18 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.273464:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa30f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226492 expref: 18 pid: 5833 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.273485:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:3.0:1788940774.273491:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.273521:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.273531:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.273651:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940774.273754:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f365c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:2359:x1875840036014976:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 372us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940774.273763:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 40 00010000:00010000:0.0:1788940774.280026:0:7198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.280049:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940774.280092:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788940774.280474:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa310a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264a0 expref: 18 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.280522:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264a0 expref: 17 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.280532:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:0.0:1788940774.280535:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788940774.280539:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36e00, rc 0) 00000100:00100000:0.0:1788940774.280758:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:10415:x1875840036014848:12345-192.168.202.17@tcp:101:bash.0 Request processed in 22442us (22962us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788940774.280769:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 57 00000100:00100000:3.0:1788940774.286233:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940774.286337:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036015232 00000100:00100000:1.0:1788940774.286350:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036015232 00000100:00100000:1.0:1788940774.286437:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 58 00000100:00100000:1.0:1788940774.286449:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:10415:x1875840036015232:12345-192.168.202.17@tcp:36:bash.0 00010000:00010000:1.0:1788940774.286851:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa311f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.286875:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa311f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.286889:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa311f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940774.286948:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1788940774.286972:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027edca95 reply state 000000001b0627b8 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa311f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940774.286982:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940774.295388:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:10415:x1875840036015232:12345-192.168.202.17@tcp:36:bash.0 Request processed in 8914us (9143us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788940774.295405:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 58 00000020:00080000:1.0:1788940774.295417:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788940774.306950:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940774.307445:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036015360 00000100:00100000:1.0:1788940774.307460:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036015360 00000100:00100000:1.0:1788940774.307542:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 59 00000100:00100000:1.0:1788940774.307555:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:10415:x1875840036015360:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:1.0:1788940774.307593:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940774.307622:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa3126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2264a7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.307753:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa312d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.307772:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264a0 expref: 21 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.307782:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa311f lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.307790:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa312d lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.307813:0:5833:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa311f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.307851:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264a0 expref: 21 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.307892:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264a0 expref: 21 pid: 7198 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940774.307909:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41012ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875840068554880:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940774.308014:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114fe3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788940774.308917:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa311f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.308932:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa311f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.308940:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa311f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.308948:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940774.308952:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa311f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.308963:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa311f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.308997:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:2.0:1788940774.309000:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940774.309004:0:3287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa312d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.309015:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa311f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940774.309022:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa311f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940774.312027:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940774.312245:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41012ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875840068554880:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940774.312285:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa312d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940774.315906:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036015488 00000100:00100000:0.0:1788940774.315931:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036015488 00010000:00010000:0.0:1788940774.316004:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264a0 expref: 21 pid: 7198 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940774.316179:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 41 00000100:00100000:0.0:1788940774.317292:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101219c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:2359:x1875840036015488:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940774.317319:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940774.317332:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264a0 expref: 21 pid: 7198 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.317351:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264a0 expref: 21 pid: 7198 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.317390:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3111 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264a0 expref: 21 pid: 7198 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.317441:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:0.0:1788940774.317448:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa312d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.317459:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa312d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.317469:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa312d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.317501:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940774.317635:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101219c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:2359:x1875840036015488:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 566us (5622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940774.317645:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 41 00010000:00010000:1.0:1788940774.318797:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa312d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.318812:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa312d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940774.318888:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788940774.318894:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940774.318922:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa312d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.318968:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa3126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264a7 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.318992:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa312d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264a7 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.319001:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:1.0:1788940774.319024:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940774.319028:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4600, rc 0) 00000100:00100000:1.0:1788940774.319104:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:10415:x1875840036015360:12345-192.168.202.17@tcp:101:bash.0 Request processed in 11551us (12170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940774.319114:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 59 00000100:00100000:2.0:1788940774.325334:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940774.325425:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036015744 00000100:00100000:3.0:1788940774.325440:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036015744 00000100:00100000:3.0:1788940774.325818:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 15 00000100:00100000:3.0:1788940774.325832:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41057c4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:10415:x1875840036015744:12345-192.168.202.17@tcp:35:bash.0 00000100:00100000:3.0:1788940774.326171:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41057c4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:10415:x1875840036015744:12345-192.168.202.17@tcp:35:bash.0 Request processed in 342us (851us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788940774.326180:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 15 00000100:00100000:2.0:1788940774.408627:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940774.408670:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41012ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068555008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940774.408779:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940774.408981:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068555008 00000100:00100000:3.0:1788940774.408993:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068555008 00000100:00100000:3.0:1788940774.409092:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788940774.409107:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068555008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940774.409158:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940774.409240:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068555008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940774.409265:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788940774.409458:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940774.409611:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41012ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068555008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940774.469596:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940774.470005:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036016000 00000100:00100000:0.0:1788940774.470021:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036016000 00000100:00100000:0.0:1788940774.470112:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 60 00000100:00100000:0.0:1788940774.470125:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:10425:x1875840036016000:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940774.470161:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940774.470238:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa3134 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2264ae expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940774.470366:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788940774.470541:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa3134 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264ae expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.470559:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f41129a4d00) 00010000:00010000:0.0:1788940774.470580:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940774.470588:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa3134 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264ae expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940774.470608:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234000, rc 0) 00000100:00100000:0.0:1788940774.470689:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:10425:x1875840036016000:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 566us (1108us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788940774.470697:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 60 00000100:00100000:1.0:1788940774.479836:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940774.480053:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036016128 00000100:00100000:3.0:1788940774.480076:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036016128 00000100:00100000:3.0:1788940774.480157:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 61 00000100:00100000:3.0:1788940774.480170:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:10425:x1875840036016128:12345-192.168.202.17@tcp:34:lfs.0 00010000:00010000:3.0:1788940774.480327:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3142 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.480348:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3142 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.480362:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3142 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.480393:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3149 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.480402:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.480410:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.480796:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3150 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.480808:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.480815:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940774.481245:0:7198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481262:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3142 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481269:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3142 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481277:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3142 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481283:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940774.481288:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3142 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481297:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3142 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481312:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:3.0:1788940774.481316:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940774.481323:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3142 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481330:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3142 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481345:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481352:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3149 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481367:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481373:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940774.481383:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481392:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3149 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481401:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4112cbfa00) 00010000:00010000:3.0:1788940774.481403:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940774.481407:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3149 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481413:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3149 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481432:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481440:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3150 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481447:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481453:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940774.481456:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481472:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3150 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481479:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:3.0:1788940774.481482:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940774.481485:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3150 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.481492:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3150 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940774.481747:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:10425:x1875840036016128:12345-192.168.202.17@tcp:34:lfs.0 Request processed in 1575us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940774.481758:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 61 00000100:00100000:2.0:1788940774.500912:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940774.503926:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036016384 00000100:00100000:3.0:1788940774.503950:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036016384 00000100:00100000:3.0:1788940774.504051:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 16 00000100:00100000:3.0:1788940774.504065:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:10425:x1875840036016384:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:3.0:1788940774.506602:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:10425:x1875840036016384:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 2518us (5682us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788940774.506625:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 16 00000100:00100000:0.0:1788940774.583097:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940774.583151:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940774.583214:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940774.583418:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036016640 00000100:00100000:2.0:1788940774.583432:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036016640 00000100:00100000:2.0:1788940774.583529:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 81 00000100:00100000:2.0:1788940774.583543:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2360:x1875840036016640:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940774.583641:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2360:x1875840036016640:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 103us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940774.583651:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 81 00000100:00100000:3.0:1788940774.584298:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036016512 00000100:00100000:3.0:1788940774.584306:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036016512 00000100:00100000:3.0:1788940774.584358:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 295 00000100:00100000:3.0:1788940774.584368:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840036016512:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940774.584459:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840036016512:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 92us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940774.584489:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 295 00000100:00100000:1.0:1788940774.585825:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036016768 00000100:00100000:1.0:1788940774.585839:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036016768 00000100:00100000:1.0:1788940774.587353:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 151 00000100:00100000:1.0:1788940774.587367:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840036016768:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940774.587546:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840036016768:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 117us (4329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940774.587556:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 151 00000100:00080000:0.0:1788940774.587781:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940774.587788:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940774.608614:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940774.608837:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036017024 00000100:00100000:3.0:1788940774.608862:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036017024 00000100:00100000:3.0:1788940774.608943:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 62 00000100:00100000:3.0:1788940774.608956:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:10428:x1875840036017024:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:3.0:1788940774.608989:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940774.609016:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3157 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2264b5 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609131:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa315e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609151:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa315e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609165:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa315e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609182:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3165 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609239:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609247:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609686:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa316c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609710:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa316c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609718:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa316c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940774.609732:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788940774.609856:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa315e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609864:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa315e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609871:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa315e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609877:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940774.609882:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa315e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609891:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa315e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609906:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:3.0:1788940774.609910:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940774.609916:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa315e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609923:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa315e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609939:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609954:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3165 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609960:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609965:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940774.609968:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609975:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3165 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609983:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4112cbfa00) 00010000:00010000:3.0:1788940774.609986:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940774.609989:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3165 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.609995:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3165 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.610053:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3157 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264b5 expref: 25 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.610070:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa316c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264b5 expref: 24 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.610078:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:3.0:1788940774.610080:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940774.610091:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37e00, rc 0) 00000100:00100000:3.0:1788940774.610244:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:10428:x1875840036017024:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 1289us (1645us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788940774.610254:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 62 00000100:00100000:0.0:1788940774.616698:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940774.616824:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036017152 00000100:00100000:1.0:1788940774.616839:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036017152 00000100:00100000:1.0:1788940774.616932:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 63 00000100:00100000:1.0:1788940774.616945:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:10428:x1875840036017152:12345-192.168.202.17@tcp:54:lfs.0 00010000:00010000:1.0:1788940774.617047:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa317a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.617071:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa317a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.617087:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa317a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.617123:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa317a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.617151:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa317a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.617158:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa317a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.617165:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940774.617171:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa317a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.617181:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa317a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.617244:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:1.0:1788940774.617248:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940774.617255:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa317a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940774.617262:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa317a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940774.618910:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:10428:x1875840036017152:12345-192.168.202.17@tcp:54:lfs.0 Request processed in 1955us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940774.618927:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 63 00000100:00100000:2.0:1788940774.626446:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940774.629915:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940774.630173:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036017536 00000100:00100000:0.0:1788940774.630225:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036017536 00000100:00100000:0.0:1788940774.630299:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 17 00000100:00100000:0.0:1788940774.630310:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:10428:x1875840036017536:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:0.0:1788940774.630649:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+25:10428:x1875840036017536:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 340us (749us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788940774.630667:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 17 00000100:00100000:3.0:1788940774.633398:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036017280 00000100:00100000:3.0:1788940774.633420:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036017280 00000100:00100000:3.0:1788940774.633513:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 4 00000100:00100000:3.0:1788940774.633525:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f366d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+25:2358:x1875840036017280:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940774.633545:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940774.633577:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa316c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264b5 expref: 25 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.633602:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:3.0:1788940774.633608:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940774.633938:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f366d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:2358:x1875840036017280:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 414us (7506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940774.633947:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 4 00000100:00100000:2.0:1788940774.939620:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940774.947179:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036017792 00000100:00100000:3.0:1788940774.947229:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036017792 00000100:00100000:3.0:1788940774.947423:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 64 00000100:00100000:3.0:1788940774.947438:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:10447:x1875840036017792:12345-192.168.202.17@tcp:101:cat.0 00010000:00010000:3.0:1788940774.947485:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940774.947518:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa3181 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2264bc expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.947681:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3188 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.947723:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3188 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.947741:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3188 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940774.947757:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788940774.947934:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa3181 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264bc expref: 27 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.947957:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3188 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264bc expref: 26 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940774.947964:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:3.0:1788940774.947966:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788940774.947970:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37e00, rc 0) 00000100:00100000:3.0:1788940774.948069:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10447:x1875840036017792:12345-192.168.202.17@tcp:101:cat.0 Request processed in 635us (8466us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788940774.948077:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 64 00010000:00010000:3.0:1788940774.984727:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940775.007777:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940775.008241:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036017920 00000100:00100000:3.0:1788940775.008257:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036017920 00000100:00100000:3.0:1788940775.008412:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 65 00000100:00100000:3.0:1788940775.008430:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10448:x1875840036017920:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:3.0:1788940775.008464:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940775.008496:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3196 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2264c3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.008608:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa319d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.008625:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa319d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.008640:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa319d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940775.008705:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788940775.008711:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940775.008746:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa319d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.008782:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3196 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264c3 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.008806:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa319d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264c3 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.008816:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:3.0:1788940775.008819:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940775.008824:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36600, rc 0) 00000100:00100000:3.0:1788940775.009057:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10448:x1875840036017920:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 633us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940775.009129:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 65 00000100:00080000:0.0:1788940775.009220:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940775.016082:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940775.016251:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036018304 00000100:00100000:0.0:1788940775.016269:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036018304 00000100:00100000:0.0:1788940775.016345:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:0.0:1788940775.016358:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10448:x1875840036018304:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:0.0:1788940775.016828:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:10448:x1875840036018304:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 471us (774us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788940775.016913:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:2.0:1788940775.027392:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940775.027506:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036018432 00000100:00100000:3.0:1788940775.027522:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036018432 00000100:00100000:3.0:1788940775.027641:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:3.0:1788940775.027799:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f364700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:10448:x1875840036018432:12345-192.168.202.17@tcp:103:lfs.0 00010000:00010000:3.0:1788940775.027823:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788940775.027914:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa312d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264a7 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.027944:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3188 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264bc expref: 27 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.027958:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3031 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226468 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.027970:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f4112cbf600) 00010000:00010000:3.0:1788940775.027984:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940775.028165:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f364700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+25:10448:x1875840036018432:12345-192.168.202.17@tcp:103:lfs.0 Request processed in 513us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940775.028175:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:3.0:1788940775.031646:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940775.031983:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036018560 00000100:00100000:1.0:1788940775.031999:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036018560 00000100:00100000:1.0:1788940775.032174:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 66 00000100:00100000:1.0:1788940775.032210:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+25:10448:x1875840036018560:12345-192.168.202.17@tcp:58:lfs.0 00010000:00010000:1.0:1788940775.032402:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa31a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940775.032432:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa31a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940775.032448:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa31a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940775.033418:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940775.033630:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788940775.033722:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788940775.034289:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+25:10448:x1875840036018560:12345-192.168.202.17@tcp:58:lfs.0 Request processed in 2096us (2650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940775.034302:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 66 00000100:00100000:2.0:1788940775.076346:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940775.080479:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036018688 00000100:00100000:1.0:1788940775.080503:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036018688 00000100:00100000:0.0:1788940775.080769:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 67 00000100:00100000:0.0:1788940775.080785:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+25:10450:x1875840036018688:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940775.080812:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940775.080841:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2264ca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.081287:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa31b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.081306:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa31b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.081320:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa31b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.081338:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.081346:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.081353:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.081813:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa31c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.081824:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa31c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082236:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa31c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940775.082293:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788940775.082300:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940775.082325:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa31c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082338:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa31c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082348:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa31b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082355:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa31b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082361:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa31b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082368:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940775.082384:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa31b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082394:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa31b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082408:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:0.0:1788940775.082411:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940775.082417:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa31b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082437:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa31b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082456:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082463:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082469:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082474:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940775.082478:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082484:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082492:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f410ad9f100) 00010000:00010000:0.0:1788940775.082495:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940775.082497:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082503:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082559:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264ca expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082576:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa31c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264ca expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.082590:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4f00) 00010000:00010000:0.0:1788940775.082592:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940775.082596:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235e00, rc 0) 00000100:00100000:0.0:1788940775.083350:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10450:x1875840036018688:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 2563us (7015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940775.083363:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 67 00000040:00080000:1.0:1788940775.818481:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940775.818497:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940775.818574:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788940775.818583:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788940775.818766:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41012aea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875840068555136:192.168.202.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788940775.818904:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114fe300 going to sleep for 11 seconds 00000100:00100000:2.0:1788940775.828324:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940775.832529:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41012aea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875840068555136:192.168.202.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788940775.835613:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036018816 00000100:00100000:3.0:1788940775.835640:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036018816 00000100:00100000:3.0:1788940775.835922:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 1 00000100:00100000:3.0:1788940775.835936:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10461:x1875840036018816:12345-192.168.202.17@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788940775.840407:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10461:x1875840036018816:12345-192.168.202.17@tcp:900:lhsmtool_posix.0 Request processed in 4453us (12078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940775.840428:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 1 00000100:00100000:2.0:1788940775.856286:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940775.856684:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036018944 00000100:00100000:3.0:1788940775.856712:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036018944 00000100:00100000:3.0:1788940775.856993:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 68 00000100:00100000:3.0:1788940775.857009:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10461:x1875840036018944:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788940775.857057:0:7198:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788940775.857230:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10461:x1875840036018944:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 Request processed in 224us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940775.857239:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 68 00000100:00100000:1.0:1788940775.885148:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940775.896923:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036019072 00000100:00100000:3.0:1788940775.896945:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036019072 00000100:00100000:3.0:1788940775.897036:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 69 00000100:00100000:3.0:1788940775.897049:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10461:x1875840036019072:12345-192.168.202.17@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788940775.897153:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa31c7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.897177:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa31c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.897213:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa31c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.897944:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31ce lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.897958:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.897967:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898014:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898023:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898030:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940775.898088:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788940775.898094:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940775.898110:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898141:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa31c7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898149:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa31c7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898157:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa31c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898164:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940775.898169:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa31c7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898178:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa31c7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898252:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9fd00) 00010000:00010000:0.0:1788940775.898256:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940775.898263:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa31c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898269:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa31c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898282:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31ce lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898289:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31ce lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898294:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898306:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940775.898309:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31ce lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898315:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31ce lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898324:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8f410ad9f300) 00010000:00010000:0.0:1788940775.898326:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940775.898329:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31ce lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898347:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa31ce lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898372:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898378:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898384:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898389:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940775.898392:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898398:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898415:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4f00) 00010000:00010000:0.0:1788940775.898417:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940775.898420:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.898426:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940775.898771:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10461:x1875840036019072:12345-192.168.202.17@tcp:34:lhsmtool_posix.0 Request processed in 1719us (13633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940775.898783:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 69 00000100:00100000:2.0:1788940775.903146:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940775.903213:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036019328 00000100:00100000:2.0:1788940775.903225:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036019328 00000100:00100000:2.0:1788940775.903298:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 70 00000100:00100000:2.0:1788940775.903313:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10461:x1875840036019328:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940775.903348:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940775.903391:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa31dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2264d1 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.903540:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa31e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.903561:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa31e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.903577:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa31e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940775.903591:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788940775.903899:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa31e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.903932:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa31e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.903940:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa31e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.903946:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940775.903951:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa31e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.903961:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa31e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.903976:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4f00) 00010000:00010000:2.0:1788940775.903979:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940775.903985:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa31e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.903991:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa31e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.904412:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa31dc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264d1 expref: 28 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.904427:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9fd00) 00010000:00010000:2.0:1788940775.904430:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940775.904436:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa31dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264d1 expref: 28 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.904448:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7200, rc 0) 00000100:00100000:2.0:1788940775.905562:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10461:x1875840036019328:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 2242us (2421us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788940775.905578:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 70 00000100:00100000:1.0:1788940775.920801:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940775.921035:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036019456 00000100:00100000:2.0:1788940775.921049:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036019456 00000100:00100000:2.0:1788940775.921135:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 71 00000100:00100000:2.0:1788940775.921147:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10461:x1875840036019456:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788940775.921211:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788940775.929917:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10461:x1875840036019456:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 Request processed in 8752us (9111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940775.929936:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 71 00000100:00100000:1.0:1788940775.950287:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940775.950449:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036019712 00000100:00100000:3.0:1788940775.950464:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036019712 00000100:00100000:3.0:1788940775.950549:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 72 00000100:00100000:3.0:1788940775.950562:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10461:x1875840036019712:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940775.950590:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940775.950594:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788940775.950629:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa319d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264c3 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.950675:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:3.0:1788940775.950681:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940775.950700:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa31f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2264d8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788940775.951712:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788940775.952356:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.952386:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.952401:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.952860:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa31f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264d8 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.952884:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264d8 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.952893:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f410ad9f300) 00010000:00010000:0.0:1788940775.952896:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940775.952910:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234200, rc 0) 00000100:00100000:0.0:1788940775.953003:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:10461:x1875840036019712:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 2443us (2741us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788940775.953014:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 72 00000100:00100000:1.0:1788940775.964442:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940775.964866:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036019968 00000100:00100000:3.0:1788940775.964882:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036019968 00000100:00100000:3.0:1788940775.964969:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 73 00000100:00100000:3.0:1788940775.964982:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:10461:x1875840036019968:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940775.965062:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940775.965099:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa31f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264d8 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.965124:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f410ad9f300) 00010000:00010000:3.0:1788940775.965138:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940775.965169:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3206 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.965212:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3206 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.965226:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3206 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.965243:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa320d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xddaff900 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.965251:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa320d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xddaff900 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.965288:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa320d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xddaff900 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.965768:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3206 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.965778:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3206 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.965786:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3206 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.965792:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940775.965797:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3206 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.965805:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3206 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.965816:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:2.0:1788940775.965819:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940775.965841:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3206 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.965849:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3206 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.965863:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa320d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xddaff900 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.965869:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa320d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xddaff900 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.965875:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa320d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xddaff900 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.965880:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940775.965883:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa320d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xddaff900 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.965889:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa320d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xddaff900 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.965898:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xddaff900 (ffff8f4112cbf600) 00010000:00010000:2.0:1788940775.965900:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940775.965903:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa320d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xddaff900 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940775.965909:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa320d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xddaff900 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940775.966043:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10461:x1875840036019968:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 1061us (1614us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940775.966073:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 73 00000100:00100000:1.0:1788940775.972988:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940775.973179:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036020096 00000100:00100000:0.0:1788940775.973230:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036020096 00000100:00100000:0.0:1788940775.973305:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 74 00000100:00100000:0.0:1788940775.973319:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10461:x1875840036020096:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940775.973355:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940775.973396:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3214 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2264df expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.973446:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa321b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.973464:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa321b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.973480:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa321b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.973626:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3214 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264df expref: 29 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.973644:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa321b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264df expref: 28 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.973654:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f410ad9f700) 00010000:00010000:0.0:1788940775.973657:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788940775.973669:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235a00, rc 0) 00000100:00100000:0.0:1788940775.973757:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:10461:x1875840036020096:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 441us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940775.973766:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 74 00000100:00100000:1.0:1788940775.976564:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940775.976788:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036020352 00000100:00100000:3.0:1788940775.976803:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036020352 00000100:00100000:3.0:1788940775.976885:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 75 00000100:00100000:3.0:1788940775.976898:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:10461:x1875840036020352:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940775.977022:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3222 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.977045:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940775.977061:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940775.977807:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788940775.977822:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 417281633767ns, next at 418281630912ns, rc = 0 00000004:00010000:3.0:1788940775.977937:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a5352eb reply state 00000000db8027d0 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940775.977949:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940775.978147:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+30:10461:x1875840036020352:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 1247us (1592us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788940775.978156:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 75 00010000:00010000:0.0:1788940775.983949:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.983974:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3222 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.983983:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3222 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.983990:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940775.983997:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3222 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.984006:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3222 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.984030:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f410ad9f700) 00010000:00010000:0.0:1788940775.984034:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788940775.984040:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3222 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940775.984047:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3222 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940775.993770:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940775.994634:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036020480 00000100:00100000:1.0:1788940775.994678:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036020480 00000100:00100000:1.0:1788940775.994777:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 76 00000100:00100000:1.0:1788940775.994790:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+29:10461:x1875840036020480:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940775.994822:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940775.994850:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3229 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2264e6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940775.994938:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3229 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264e6 expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940775.994956:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3229 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264e6 expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940775.994978:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f410ad9f700) 00010000:00010000:1.0:1788940775.994982:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940775.994987:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4a00, rc 0) 00000100:00100000:1.0:1788940775.995074:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+30:10461:x1875840036020480:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 286us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940775.995082:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 76 00010000:00010000:3.0:1788940776.011492:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940776.011739:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940776.012052:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036020608 00000100:00100000:3.0:1788940776.012065:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036020608 00000100:00100000:3.0:1788940776.012127:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 25 00000100:00100000:3.0:1788940776.012155:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875840036020608:12345-192.168.202.17@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788940776.012232:0:6673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:3.0:1788940776.012274:0:6673:0:(genops.c:1384:class_connect()) connect: client 9fbe6afa-4201-4af1-bbe2-c715064eeb39, cookie 0xa1d8aa9164aa3230 00002000:00100000:3.0:1788940776.012289:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9fbe6afa-4201-4af1-bbe2-c715064eeb39/ffff8f41109bb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788940776.012319:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788940776.012634:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788940776.012913:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8f4108742800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940776.013007:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2357:x1875840036020608:12345-192.168.202.17@tcp:8:lhsmtool_posix.0 Request processed in 852us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940776.013015:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 25 00000100:00100000:0.0:1788940776.034973:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940776.035044:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036020736 00000100:00100000:2.0:1788940776.035062:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036020736 00000100:00100000:2.0:1788940776.035162:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 26 00000100:00100000:2.0:1788940776.035174:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:0:x1875840036020736:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788940776.035299:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940776.135425:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:0:x1875840036020736:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 Request processed in 100235us (100446us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788940776.135445:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 26 00000001:00080000:0.0:1788940776.139217:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1788940776.139241:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000100:00100000:2.0:1788940776.155394:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940776.155491:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036020992 00000100:00100000:0.0:1788940776.155506:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036020992 00000100:00100000:0.0:1788940776.155580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00100000:0.0:1788940776.155593:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+30:10461:x1875840036020992:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788940776.156086:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+31:10461:x1875840036020992:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 Request processed in 493us (705us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788940776.156095:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00100000:3.0:1788940776.173333:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940776.173817:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036021248 00000100:00100000:1.0:1788940776.173831:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036021248 00000100:00100000:1.0:1788940776.173912:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 77 00000100:00100000:1.0:1788940776.173924:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+31:10461:x1875840036021248:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788940776.174073:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+31:10461:x1875840036021248:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 151us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940776.174082:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 77 00000100:00100000:1.0:1788940776.202881:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940776.203779:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036021376 00000100:00100000:2.0:1788940776.203796:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036021376 00000100:00100000:2.0:1788940776.203865:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 78 00000100:00100000:2.0:1788940776.203876:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+31:10461:x1875840036021376:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940776.203904:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940776.203934:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3237 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2264ed expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.204027:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa323e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.204046:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa323e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.204061:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa323e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940776.204126:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940776.204150:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa323e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.204184:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3237 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264ed expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.204225:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa323e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264ed expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.204235:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f410ad9f700) 00010000:00010000:2.0:1788940776.204238:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788940776.204243:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6a00, rc 0) 00000100:00100000:2.0:1788940776.204334:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:10461:x1875840036021376:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 458us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940776.204342:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 78 00000100:00100000:1.0:1788940776.223759:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940776.223857:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036021504 00000100:00100000:0.0:1788940776.223874:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036021504 00000100:00100000:0.0:1788940776.223956:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 27 00000100:00100000:0.0:1788940776.223968:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840036021504:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940776.223993:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940776.224023:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3245 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2264f4 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940776.224058:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa111e7, blocks: 0x1 00010000:00010000:0.0:1788940776.224083:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=417s v=(0 0) 00010000:00010000:0.0:1788940776.224089:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940776.224101:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264f4 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.224123:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264f4 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.224140:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234c00, rc 0) 00000100:00100000:0.0:1788940776.224239:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840036021504:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 273us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940776.224257:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 27 00000100:00100000:0.0:1788940776.227841:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940776.228001:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036021760 00000100:00100000:1.0:1788940776.228016:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036021760 00000100:00100000:1.0:1788940776.228093:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 79 00000100:00100000:1.0:1788940776.228105:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:10461:x1875840036021760:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788940776.228294:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:10461:x1875840036021760:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 190us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940776.228303:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 79 00000100:00100000:3.0:1788940776.242614:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940776.242946:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036021888 00000100:00100000:0.0:1788940776.242960:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036021888 00000100:00100000:0.0:1788940776.243035:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 28 00000100:00100000:0.0:1788940776.243047:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:10461:x1875840036021888:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940776.243073:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940776.243097:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa324c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2264fb expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.243144:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3245 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264f4 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.243154:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940776.243160:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940776.243166:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa324c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264fb expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.246257:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264f4 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.246292:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3245 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264f4 expref: 7 pid: 6671 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940776.246312:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41012ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6674:1875840068555264:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940776.246476:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bf600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940776.262981:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940776.263592:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036022016 00000100:00100000:3.0:1788940776.263607:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036022016 00010000:00010000:3.0:1788940776.263670:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3245 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264f4 expref: 8 pid: 6671 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940776.263730:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 42 00000100:00100000:3.0:1788940776.263742:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41080e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2359:x1875840036022016:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940776.263763:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940776.263792:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3245 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264f4 expref: 8 pid: 6671 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.263809:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3245 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264f4 expref: 8 pid: 6671 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.263861:0:7622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940776.263866:0:7622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940776.263879:0:7622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa324c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264fb expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.263892:0:7622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa324c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264fb expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.263941:0:7622:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa324c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264fb expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940776.263959:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4101218000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7622:1875840068555392:192.168.202.17@tcp:105: 00000100:00100000:3.0:1788940776.264091:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410f69a240 going to sleep for 11 seconds 00010000:00010000:2.0:1788940776.267332:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3245 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264f4 expref: 8 pid: 6671 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940776.267391:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41012ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6674:1875840068555264:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940776.267431:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa324c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264fb expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.267451:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234200, rc 0) 00000100:00100000:2.0:1788940776.269257:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4101218000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7622:1875840068555392:192.168.202.17@tcp:105: 00010000:00010000:2.0:1788940776.269299:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940776.269376:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41080e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036022016:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 5635us (6409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940776.269390:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 42 00000100:00100000:0.0:1788940776.270038:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:10461:x1875840036021888:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 26987us (27435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940776.270060:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 28 00000100:00100000:1.0:1788940776.274878:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940776.279371:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036022144 00000100:00100000:0.0:1788940776.279392:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036022144 00002000:00100000:0.0:1788940776.279754:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8f41012ae680 x1875840036022144/t0(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:752/0 lens 504/0 e 0 to 0 dl 1788940787 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788940776.279770:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f41012ae680 with x1875840036022144 ext(0->8) 00002000:00010000:0.0:1788940776.279792:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f41012ae680 00000100:00100000:0.0:1788940776.279844:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:0.0:1788940776.279856:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840036022144:12345-192.168.202.17@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788940776.281376:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2359:x1875840036022144:12345-192.168.202.17@tcp:4:lhsmtool_posix.0 Request processed in 1501us (6494us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788940776.281393:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 0 00002000:00100000:0.0:1788940776.281407:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8f41012ae680 x1875840036022144/t4294967302(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:752/0 lens 504/448 e 0 to 0 dl 1788940787 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788940776.281419:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f41012ae680 with x1875840036022144 ext(0->8) 00002000:00010000:0.0:1788940776.281427:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f41012ae680 00000100:00100000:3.0:1788940776.288044:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940776.288159:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036022272 00000100:00100000:2.0:1788940776.288176:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036022272 00000100:00100000:2.0:1788940776.288280:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 80 00000100:00100000:2.0:1788940776.288297:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:10461:x1875840036022272:12345-192.168.202.17@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788940776.470941:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:10461:x1875840036022272:12345-192.168.202.17@tcp:44:lhsmtool_posix.0 Request processed in 182630us (182887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940776.470957:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 80 00000001:00080000:1.0:1788940776.471023:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788940776.471146:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788940776.471182:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1788940776.471730:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940776.471757:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068555520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788940776.471833:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940776.471901:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068555520 00000100:00100000:0.0:1788940776.471910:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068555520 00000100:00100000:0.0:1788940776.471974:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940776.471984:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068555520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788940776.472178:0:6671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788940776.472182:0:6671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788940775 00002000:00010000:0.0:1788940776.472213:0:6671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788940776.472216:0:6671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788940775 -> 1788940775 00002000:00010000:0.0:1788940776.472218:0:6671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788940776.472260:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875840068555520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 276us (427us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788940776.472268:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788940776.472304:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788940776.472339:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f413508df80/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788940776.472345:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068555520:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1788940776.472659:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788940776.472672:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788940776.481989:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940776.490928:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036022400 00000100:00100000:1.0:1788940776.490952:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036022400 00000100:00100000:0.0:1788940776.491109:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 30 00000100:00100000:0.0:1788940776.491124:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41086ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2358:x1875840036022400:12345-192.168.202.17@tcp:16:lhsmtool_posix.0 00000040:00080000:2.0:1788940776.524222:0:11993:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788940776.524235:0:11993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940776.524286:0:11993:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788940776.524293:0:11993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788940776.633540:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788940776.633567:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788940776.641322:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41086ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840036022400:12345-192.168.202.17@tcp:16:lhsmtool_posix.0 Request processed in 150184us (159331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940776.641342:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 30 00000100:00100000:2.0:1788940776.651600:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940776.652135:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036022656 00000100:00100000:1.0:1788940776.652149:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036022656 00000100:00100000:1.0:1788940776.652449:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 81 00000100:00100000:1.0:1788940776.652905:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:10461:x1875840036022656:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788940776.652984:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940776.653023:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa323e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264ed expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.653364:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f410ad9f700) 00010000:00010000:1.0:1788940776.653373:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940776.653422:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa3253 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.653440:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa3253 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.653453:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa3253 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940776.655439:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f67a36fc reply state 0000000056ff5ae6 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa3253 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940776.655771:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940776.656045:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:10461:x1875840036022656:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 3575us (4453us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788940776.656067:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 81 00010000:00010000:2.0:1788940776.666773:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa3253 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.666810:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa3253 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.666819:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa3253 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.666827:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940776.666833:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa3253 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.666858:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa3253 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.666881:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f410ad9f700) 00010000:00010000:2.0:1788940776.666885:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940776.666891:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa3253 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.666898:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa3253 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940776.667586:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940776.668957:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036022784 00000100:00100000:0.0:1788940776.668978:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036022784 00000100:00100000:0.0:1788940776.669058:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 31 00000100:00100000:0.0:1788940776.669071:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840036022784:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788940776.669353:0:6671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788940776.669367:0:6671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788940775 -> 1788940773 00002000:00010000:0.0:1788940776.669370:0:6671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788940770 00002000:00010000:0.0:1788940776.669373:0:6671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788940775 -> 1788940773 00002000:00010000:0.0:1788940776.669375:0:6671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788940776.669448:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2358:x1875840036022784:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 Request processed in 379us (1872us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788940776.669466:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 31 00000100:00100000:0.0:1788940776.673165:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940776.674651:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036023040 00000100:00100000:3.0:1788940776.674669:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036023040 00000100:00100000:3.0:1788940776.674756:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 82 00000100:00100000:3.0:1788940776.674767:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:10461:x1875840036023040:12345-192.168.202.17@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788940776.674849:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.674870:0:7198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa321b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264df expref: 13 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.674902:0:7198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.674957:0:7198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa321b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264df expref: 13 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.674973:0:7198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa321b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264df expref: 13 pid: 7198 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940776.674988:0:7198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f410121ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068555648:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940776.675456:0:7198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1eaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940776.680576:0:7198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f410121ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068555648:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940776.680621:0:7198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940776.683748:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940776.683822:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036023168 00000100:00100000:3.0:1788940776.683839:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036023168 00010000:00010000:3.0:1788940776.683895:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa321b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264df expref: 14 pid: 7198 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940776.683945:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 43 00000100:00100000:3.0:1788940776.683957:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:2358:x1875840036023168:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940776.683976:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940776.683985:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa321b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264df expref: 14 pid: 7198 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.683999:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa321b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264df expref: 14 pid: 7198 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.684026:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa321b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264df expref: 14 pid: 7198 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.684066:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f410ad9f700) 00010000:00010000:3.0:1788940776.684074:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.684085:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.684094:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.684129:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940776.684239:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:2358:x1875840036023168:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 283us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940776.684246:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 43 00010000:00010000:2.0:1788940776.684393:0:7198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.684402:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.684441:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.684449:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.684457:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.684537:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940776.684543:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.684564:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.684575:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f410ad9f700) 00010000:00010000:2.0:1788940776.684578:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788940776.684583:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.684591:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa325a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940776.684640:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:10461:x1875840036023040:12345-192.168.202.17@tcp:55:lhsmtool_posix.0 Request processed in 9875us (11486us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788940776.684650:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 82 00000100:00100000:0.0:1788940776.690732:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940776.690775:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036023296 00000100:00100000:0.0:1788940776.690785:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036023296 00000100:00100000:0.0:1788940776.690858:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 32 00000100:00100000:0.0:1788940776.690869:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036023296:12345-192.168.202.17@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788940776.690919:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3261 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.691100:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa324c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264fb expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.691115:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940776.691120:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940776.691125:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3261 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.691165:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa324c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264fb expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.691180:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa324c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264fb expref: 7 pid: 6674 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940776.691448:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6674:1875840068555776:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940776.691605:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114fe300 going to sleep for 11 seconds 00000100:00100000:2.0:1788940776.696725:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6674:1875840068555776:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940776.696769:0:6674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3261 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940776.696879:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940776.698784:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036023424 00000100:00100000:3.0:1788940776.698801:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036023424 00010000:00010000:3.0:1788940776.698863:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa324c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264fb expref: 8 pid: 6674 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940776.698925:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 44 00000100:00100000:3.0:1788940776.698935:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2359:x1875840036023424:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940776.698953:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940776.698984:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa324c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264fb expref: 8 pid: 6674 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.699001:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa324c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264fb expref: 8 pid: 6674 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.700153:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa324c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264fb expref: 8 pid: 6674 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.700210:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788940776.700216:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940776.700232:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3261 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.700245:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3261 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.701016:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940776.701177:0:6674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3261 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.701227:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3261 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940776.703638:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036023424:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 4686us (6751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940776.703657:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 44 00010000:00010000:2.0:1788940776.704957:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3261 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.705003:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3261 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.705013:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3261 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.705021:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940776.705027:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3261 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.705039:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3261 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.705075:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3261 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.705084:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f44f7ce0/0xa1d8aa9164aa3261 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940776.705205:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840036023296:12345-192.168.202.17@tcp:1:lhsmtool_posix.0 Request processed in 14322us (14468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940776.705216:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 32 00000100:00100000:0.0:1788940776.720025:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940776.723579:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036023680 00000100:00100000:1.0:1788940776.723598:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036023680 00000100:00100000:0.0:1788940776.723826:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 83 00000100:00100000:0.0:1788940776.723842:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+12:10461:x1875840036023680:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788940776.723930:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3268 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.723948:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.723985:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.724318:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.724330:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3229 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264e6 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.724338:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.724386:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3229 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264e6 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940776.724401:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3229 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264e6 expref: 13 pid: 5833 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940776.724417:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068555904:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940776.724685:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114fe540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940776.729158:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940776.729266:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068555904:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940776.729303:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940776.729580:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036023808 00000100:00100000:2.0:1788940776.729593:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036023808 00010000:00010000:2.0:1788940776.729722:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3229 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264e6 expref: 14 pid: 5833 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940776.729790:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 45 00000100:00100000:2.0:1788940776.729804:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101219f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:2358:x1875840036023808:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940776.729824:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940776.729833:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3229 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264e6 expref: 14 pid: 5833 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.729912:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3229 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264e6 expref: 14 pid: 5833 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.729942:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3229 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264e6 expref: 14 pid: 5833 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.729961:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f410ad9f700) 00010000:00010000:2.0:1788940776.729967:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.729978:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.729987:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940776.730020:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940776.730063:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.730074:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940776.730106:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101219f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:2358:x1875840036023808:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 304us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940776.730117:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 45 00000001:00080000:1.0:1788940776.730294:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788940776.730471:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788940776.730521:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788940776.730609:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41012ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1875840068556032:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788940776.730691:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940776.730803:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7b9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940776.731136:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068556032 00000100:00100000:2.0:1788940776.731149:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068556032 00000100:00100000:2.0:1788940776.731235:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940776.731245:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875840068556032:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788940776.731332:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875840068556032:12345-0@lo:1000:mdt00_002.0 Request processed in 89us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940776.731340:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940776.731872:0:5835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788940776.731879:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f413508df80, transno 4294967303 00000100:00100000:1.0:1788940776.731906:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41012ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1875840068556032:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788940776.732339:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788940776.732420:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41012ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1875840068556160:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788940776.732467:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940776.732485:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7b96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940776.733451:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068556160 00000100:00100000:2.0:1788940776.733459:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068556160 00000100:00100000:2.0:1788940776.733508:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940776.733518:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875840068556160:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788940776.733826:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1875840068556160:12345-0@lo:1000:mdt00_002.0 Request processed in 306us (1355us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788940776.733837:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788940776.734384:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41012ad180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1875840068556160:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788940776.734424:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734436:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734444:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734450:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940776.734455:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734462:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734479:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f410ad9f700) 00010000:00010000:1.0:1788940776.734481:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940776.734486:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734493:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa326f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734530:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa31a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734537:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa31a4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734543:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa31a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734554:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940776.734557:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa31a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734563:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa31a4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734572:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4f00) 00010000:00010000:1.0:1788940776.734574:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940776.734577:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa31a4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734583:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa31a4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734604:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734619:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa31c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264ca expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734628:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734660:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa31c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264ca expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.734690:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa31c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264ca expref: 16 pid: 5834 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940776.734722:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41012ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068556288:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940776.735230:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7b96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940776.743006:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940776.743334:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036023936 00000100:00100000:3.0:1788940776.743345:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036023936 00010000:00010000:3.0:1788940776.743401:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa31c0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264ca expref: 17 pid: 5834 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940776.743449:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 46 00000100:00100000:3.0:1788940776.743459:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:2359:x1875840036023936:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940776.743474:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940776.743482:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa31c0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264ca expref: 17 pid: 5834 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.743507:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa31c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264ca expref: 17 pid: 5834 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.743531:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4f00) 00010000:00010000:3.0:1788940776.743537:0:7622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.743549:0:7622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.743556:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.743577:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940776.743630:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:2359:x1875840036023936:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 173us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940776.743639:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 46 00010000:00010000:1.0:1788940776.745978:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa31c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2264ca expref: 16 pid: 5834 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940776.746002:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41012ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068556288:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940776.746027:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746036:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746042:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746055:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746062:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746069:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746074:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940776.746078:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746097:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746128:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4f00) 00010000:00010000:1.0:1788940776.746131:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940776.746136:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746142:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3276 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746153:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746160:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3268 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746166:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746170:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940776.746173:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746179:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3268 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746205:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4f00) 00010000:00010000:1.0:1788940776.746207:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788940776.746210:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3268 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.746225:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3268 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940776.746626:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:10461:x1875840036023680:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 22786us (26609us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788940776.746638:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 83 00000020:00080000:1.0:1788940776.746645:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788940776.746783:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788940776.746788:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940776.746833:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788940776.746839:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788940776.750852:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940776.751020:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036024192 00000100:00100000:1.0:1788940776.751037:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036024192 00000100:00100000:1.0:1788940776.751113:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 20 00000100:00100000:1.0:1788940776.751134:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:10461:x1875840036024192:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788940776.752017:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788940776.752127:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788940776.752178:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa327d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.752298:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa327d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.752311:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa327d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.752321:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa327d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.752328:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa327d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.752335:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa327d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940776.752367:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940776.752438:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940776.752452:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa327d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.752463:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5600 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940776.752468:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa327d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.752478:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa327d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.752515:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8f41129a4000) 00010000:00010000:3.0:1788940776.752582:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788940776.752590:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa327d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.752596:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa327d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940776.752621:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940776.752623:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940776.752625:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940776.752667:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:10461:x1875840036024192:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 Request processed in 1540us (1832us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788940776.752677:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 20 00000020:00080000:1.0:1788940776.752683:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788940777.036672:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788940777.054234:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:0.0:1788940777.054261:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:0.0:1788940777.054268:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1788940777.480780:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068556800:0@lo:400:kworker.0 00000100:00100000:0.0:1788940777.480904:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940777.480999:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940777.481007:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068556672:0@lo:400:kworker.0 00000100:00100000:2.0:1788940777.481020:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068556544:0@lo:400:kworker.0 00000100:00100000:2.0:1788940777.481060:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940777.481086:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068556800 00000100:00100000:2.0:1788940777.481089:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788940777.481094:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068556416:0@lo:400:kworker.0 00000100:00100000:0.0:1788940777.481096:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068556800 00000100:00100000:2.0:1788940777.481122:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940777.481140:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068556928:0@lo:400:kworker.0 00000100:00100000:2.0:1788940777.481161:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940777.481170:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068556544 00000100:00100000:0.0:1788940777.481175:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068556544 00000100:00100000:2.0:1788940777.481212:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788940777.481289:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068556800:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788940777.481298:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940777.481316:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940777.481363:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068556672 00000100:00100000:1.0:1788940777.481367:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068556672 00000100:00100000:2.0:1788940777.481406:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068556800:12345-0@lo:400:kworker.0 Request processed in 185us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940777.481453:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068556416 00000100:00100000:3.0:1788940777.481460:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068556416 00000100:00100000:3.0:1788940777.481495:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788940777.481502:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068556416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940777.481551:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3304:x1875840068556416:12345-0@lo:400:kworker.0 Request processed in 49us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940777.481559:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788940777.481617:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068556416:0@lo:400:kworker.0 00000100:00100000:3.0:1788940777.481709:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068556928 00000100:00100000:3.0:1788940777.481713:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068556928 00000100:00100000:3.0:1788940777.481763:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788940777.481771:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068556928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940777.481847:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788940777.481887:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068556928:12345-0@lo:400:kworker.0 Request processed in 116us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940777.481895:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788940777.481925:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068556544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940777.481970:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788940777.481985:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1788940777.482015:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f413f367800, transno 4294967301 00000100:00100000:3.0:1788940777.482038:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068556928:0@lo:400:kworker.0 00000100:00080000:3.0:1788940777.482381:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940777.482386:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940777.482516:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068556544:12345-0@lo:400:kworker.0 Request processed in 660us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940777.482524:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788940777.482617:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068556544:0@lo:400:kworker.0 00000100:00100000:1.0:1788940777.482738:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788940777.482749:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068556672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940777.482792:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068556672:12345-0@lo:400:kworker.0 Request processed in 46us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940777.482798:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788940777.482900:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788940777.483001:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068556800:0@lo:400:kworker.0 00000100:00100000:3.0:1788940777.483023:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068556672:0@lo:400:kworker.0 00000100:00100000:1.0:1788940777.995000:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940777.995036:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41012af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068557056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940777.995147:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940777.995284:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068557056 00000100:00100000:1.0:1788940777.995296:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068557056 00000100:00100000:1.0:1788940777.995372:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788940777.995383:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4135012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068557056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940777.995439:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940777.995499:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4135012c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068557056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940777.995507:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788940777.995855:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41012af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068557056:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940778.057790:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940778.983799:0:12047:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940778.983815:0:12047:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940778.984023:0:12047:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788940778.984031:0:12047:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788940779.080645:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940779.080725:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036024448 00000100:00100000:1.0:1788940779.080739:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036024448 00000100:00100000:1.0:1788940779.080831:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 84 00000100:00100000:1.0:1788940779.080843:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:10479:x1875840036024448:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:1.0:1788940779.080893:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940779.080919:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa3284 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226502 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.081045:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa328b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.081063:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa328b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.081074:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa328b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940779.081088:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788940779.081276:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa3284 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226502 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.081294:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa328b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226502 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.081304:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:1.0:1788940779.081308:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788940779.081312:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5200, rc 0) 00000100:00100000:1.0:1788940779.081387:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:10479:x1875840036024448:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 547us (759us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788940779.081401:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 84 00000100:00080000:0.0:1788940779.081584:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788940779.082528:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940779.095362:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940779.095438:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036024576 00000100:00100000:0.0:1788940779.095455:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036024576 00000100:00100000:0.0:1788940779.095542:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 85 00000100:00100000:0.0:1788940779.095553:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:10479:x1875840036024576:12345-192.168.202.17@tcp:34:lfs.0 00010000:00010000:0.0:1788940779.095665:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3299 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.095686:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3299 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.095700:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3299 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.095719:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa32a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.095726:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa32a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.095747:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa32a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096128:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa32a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096137:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa32a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096145:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa32a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940779.096237:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa32a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096253:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3299 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096261:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3299 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096268:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3299 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096275:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940779.096280:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3299 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096288:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3299 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096302:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:0.0:1788940779.096312:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940779.096320:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3299 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096326:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3299 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096351:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa32a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096357:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa32a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096363:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa32a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096369:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940779.096372:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa32a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096378:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa32a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096386:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f410ad9f600) 00010000:00010000:0.0:1788940779.096389:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940779.096392:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa32a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096397:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa32a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096412:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa32a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096424:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa32a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096430:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa32a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096436:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940779.096439:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa32a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096445:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa32a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096454:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:0.0:1788940779.096456:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940779.096459:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa32a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.096464:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa32a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940779.096572:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:10479:x1875840036024576:12345-192.168.202.17@tcp:34:lfs.0 Request processed in 1017us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940779.096581:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 85 00000100:00100000:3.0:1788940779.141325:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940779.141428:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036024832 00000100:00100000:1.0:1788940779.141441:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036024832 00000100:00100000:1.0:1788940779.141523:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 86 00000100:00100000:1.0:1788940779.141537:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:10482:x1875840036024832:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:1.0:1788940779.141567:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940779.141595:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa32ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226509 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.141697:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa32b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.141716:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa32b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.141730:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa32b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.141748:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa32bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.141756:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa32bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.141763:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa32bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142113:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa32c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142135:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa32c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142143:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa32c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940779.142156:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788940779.142329:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa32b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142347:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa32b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142355:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa32b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142362:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940779.142368:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa32b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142376:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa32b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142390:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:1.0:1788940779.142393:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940779.142399:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa32b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142406:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa32b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142419:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa32bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142432:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa32bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142438:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa32bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142443:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940779.142446:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa32bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142453:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa32bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142462:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f41129a4e00) 00010000:00010000:1.0:1788940779.142464:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940779.142467:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa32bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142473:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa32bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142522:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa32ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226509 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142536:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa32c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226509 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.142544:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4500) 00010000:00010000:1.0:1788940779.142547:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940779.142555:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5600, rc 0) 00000100:00100000:1.0:1788940779.142638:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:10482:x1875840036024832:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 1103us (1330us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788940779.142647:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 86 00000100:00100000:0.0:1788940779.148400:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940779.148483:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036024960 00000100:00100000:2.0:1788940779.148496:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036024960 00000100:00100000:2.0:1788940779.148567:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 87 00000100:00100000:2.0:1788940779.148579:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:10482:x1875840036024960:12345-192.168.202.17@tcp:54:lfs.0 00010000:00010000:2.0:1788940779.148669:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa32d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.148690:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa32d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.148705:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa32d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.148738:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa32d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.148745:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa32d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.148753:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa32d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.148760:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940779.148766:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa32d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.148775:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa32d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.148809:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4500) 00010000:00010000:2.0:1788940779.148813:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940779.148820:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa32d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.148827:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa32d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940779.148916:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:10482:x1875840036024960:12345-192.168.202.17@tcp:54:lfs.0 Request processed in 338us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940779.148924:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 87 00000100:00100000:3.0:1788940779.156817:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940779.156923:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036025216 00000100:00100000:0.0:1788940779.156937:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036025216 00000100:00100000:0.0:1788940779.157010:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 21 00000100:00100000:0.0:1788940779.157022:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41057c5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:10482:x1875840036025216:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:0.0:1788940779.157404:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41057c5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:10482:x1875840036025216:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 384us (603us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788940779.157413:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 21 00000100:00100000:2.0:1788940779.196157:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940779.200393:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036025472 00000100:00100000:0.0:1788940779.200417:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036025472 00000100:00100000:0.0:1788940779.200503:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 88 00000100:00100000:0.0:1788940779.200517:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:10001:x1875840036025472:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:0.0:1788940779.200551:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940779.200580:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa32d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226510 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.201482:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.201507:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa32c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226509 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.201517:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.201565:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa32c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226509 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.201582:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa32c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226509 expref: 23 pid: 5834 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940779.201600:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a042300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875840068557184:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940779.202032:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114fee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940779.211139:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940779.211844:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a042300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875840068557184:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940779.211884:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940779.215299:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036025600 00000100:00100000:3.0:1788940779.215324:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036025600 00010000:00010000:3.0:1788940779.215408:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa32c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226509 expref: 24 pid: 5834 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940779.215470:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 47 00000100:00100000:3.0:1788940779.215483:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:2359:x1875840036025600:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940779.215503:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940779.215513:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa32c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226509 expref: 24 pid: 5834 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.215531:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa32c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226509 expref: 24 pid: 5834 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.215565:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa32c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226509 expref: 24 pid: 5834 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.215597:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4500) 00010000:00010000:3.0:1788940779.215603:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.215616:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.215626:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.215660:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940779.217873:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:2359:x1875840036025600:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 2374us (6728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940779.217893:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 47 00010000:00010000:3.0:1788940779.222479:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.222504:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940779.222538:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788940779.224353:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa32d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226510 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.224388:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226510 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.224399:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4500) 00010000:00010000:3.0:1788940779.224412:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940779.224417:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234c00, rc 0) 00000100:00100000:3.0:1788940779.224509:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:10001:x1875840036025472:12345-192.168.202.17@tcp:101:bash.0 Request processed in 23994us (28368us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788940779.224520:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 88 00000100:00100000:3.0:1788940779.239292:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940779.239358:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036025856 00000100:00100000:3.0:1788940779.239373:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036025856 00000100:00100000:3.0:1788940779.239441:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 89 00000100:00100000:3.0:1788940779.239452:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:10001:x1875840036025856:12345-192.168.202.17@tcp:36:bash.0 00010000:00010000:3.0:1788940779.241162:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa32ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.241214:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa32ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.241230:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa32ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940779.241324:0:7198:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788940779.242856:0:7198:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047f913c9 reply state 0000000021977f67 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa32ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940779.242876:0:7198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788940779.243049:0:7198:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788940779.243516:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10001:x1875840036025856:12345-192.168.202.17@tcp:36:bash.0 Request processed in 4058us (4233us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788940779.243527:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 89 00000020:00080000:3.0:1788940779.243535:0:7198:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788940779.249782:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa32ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.249811:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa32ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.249822:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa32ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.249830:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940779.249836:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa32ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.249846:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa32ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.249868:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4500) 00010000:00010000:3.0:1788940779.249872:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940779.249879:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa32ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.249886:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa32ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940779.251293:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940779.251518:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036025984 00000100:00100000:2.0:1788940779.251533:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036025984 00000100:00100000:2.0:1788940779.251601:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 90 00000100:00100000:2.0:1788940779.251614:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10001:x1875840036025984:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:2.0:1788940779.251655:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940779.251682:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa32f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226517 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.251774:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa32f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226517 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.251791:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa32f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226517 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.251833:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4500) 00010000:00010000:2.0:1788940779.251837:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940779.251842:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7200, rc 0) 00000100:00100000:2.0:1788940779.251923:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10001:x1875840036025984:12345-192.168.202.17@tcp:101:bash.0 Request processed in 311us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940779.251931:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 90 00000100:00100000:0.0:1788940779.259564:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940779.259706:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036026112 00000100:00100000:1.0:1788940779.259720:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036026112 00000100:00100000:1.0:1788940779.259813:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 33 00000100:00100000:1.0:1788940779.259827:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:10001:x1875840036026112:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:1.0:1788940779.259852:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940779.259883:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa32fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22651e expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940779.259918:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa111e5, atime: 0x6aa111e2, ctime: 0x6aa111e5, blocks: 0xb 00010000:00010000:1.0:1788940779.259948:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1788940779.259954:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940779.259964:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa32fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22651e expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.259988:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa32fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22651e expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.260003:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4600, rc 0) 00000100:00100000:1.0:1788940779.260079:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:10001:x1875840036026112:12345-192.168.202.17@tcp:101:bash.0 Request processed in 255us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940779.260087:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 33 00000100:00080000:0.0:1788940779.260650:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940779.269078:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940779.269218:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036026240 00000100:00100000:3.0:1788940779.269232:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036026240 00002000:00010000:3.0:1788940779.269290:0:6677:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788940779.269295:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f413f364700 with x1875840036026240 ext(0->18446744073709551615) 00002000:00010000:3.0:1788940779.269310:0:6677:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f413f364700. 00000100:00100000:3.0:1788940779.269361:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 1 00000100:00100000:3.0:1788940779.269373:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f364700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036026240:12345-192.168.202.17@tcp:10:bash.0 00002000:00010000:3.0:1788940779.270351:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788940779.270360:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788940773 -> 1788940778 00002000:00010000:3.0:1788940779.270364:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788940770 -> 1788940770 00002000:00010000:3.0:1788940779.270366:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788940773 -> 1788940778 00002000:00010000:3.0:1788940779.270368:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788940779.270450:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f364700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2359:x1875840036026240:12345-192.168.202.17@tcp:10:bash.0 Request processed in 1077us (1384us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788940779.270460:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 1 00002000:00010000:3.0:1788940779.270465:0:6677:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788940779.270469:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f413f364700 with x1875840036026240 ext(0->18446744073709551615) 00002000:00010000:3.0:1788940779.270475:0:6677:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f413f364700. 00000100:00100000:1.0:1788940779.355593:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940779.355742:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036026368 00000100:00100000:2.0:1788940779.355757:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036026368 00000100:00100000:2.0:1788940779.355863:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 91 00000100:00100000:2.0:1788940779.355876:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10496:x1875840036026368:12345-192.168.202.17@tcp:34:lfs.0 00010000:00010000:2.0:1788940779.355985:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3302 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356010:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3302 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356025:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3302 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356045:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3309 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356053:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356060:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356466:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356477:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356484:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940779.356539:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356553:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3302 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356560:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3302 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356566:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3302 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356573:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940779.356577:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3302 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356585:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3302 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356599:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:2.0:1788940779.356602:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940779.356608:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3302 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356622:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3302 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356639:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356644:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3309 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356649:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356654:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940779.356657:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356663:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3309 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356671:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f41054d7400) 00010000:00010000:2.0:1788940779.356673:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940779.356675:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3309 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356680:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3309 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356696:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356701:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3310 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356713:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356717:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940779.356720:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356726:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356734:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4500) 00010000:00010000:2.0:1788940779.356736:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940779.356739:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3310 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.356745:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3310 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940779.357395:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10496:x1875840036026368:12345-192.168.202.17@tcp:34:lfs.0 Request processed in 1516us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940779.357407:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 91 00000100:00100000:0.0:1788940779.411365:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940779.411524:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036026624 00000100:00100000:2.0:1788940779.411539:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036026624 00000100:00100000:2.0:1788940779.411622:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 92 00000100:00100000:2.0:1788940779.411635:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:10499:x1875840036026624:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940779.411662:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940779.411929:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3317 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226525 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.412062:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa331e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.412080:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa331e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.412095:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa331e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.412114:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3325 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.412122:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.412128:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.412547:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa332c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.412558:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa332c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.412565:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa332c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940779.412576:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788940779.412964:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa331e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.412974:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa331e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.412990:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa331e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.412996:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940779.413001:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa331e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.413011:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa331e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.413026:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:2.0:1788940779.413030:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940779.413036:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa331e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.413043:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa331e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.413058:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.413064:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3325 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.413070:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.413075:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940779.413078:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.413096:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3325 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.413104:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f41054d7400) 00010000:00010000:2.0:1788940779.413106:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940779.413110:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3325 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.413116:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3325 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.413172:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3317 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226525 expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.413246:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa332c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226525 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.413254:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4500) 00010000:00010000:2.0:1788940779.413256:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788940779.413259:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6a00, rc 0) 00000100:00100000:2.0:1788940779.413518:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+29:10499:x1875840036026624:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 1885us (2168us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788940779.413527:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 92 00000100:00100000:1.0:1788940779.420546:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940779.420732:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036026752 00000100:00100000:0.0:1788940779.420746:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036026752 00000100:00100000:0.0:1788940779.421125:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 93 00000100:00100000:0.0:1788940779.421139:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+29:10499:x1875840036026752:12345-192.168.202.17@tcp:54:lfs.0 00010000:00010000:0.0:1788940779.421288:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.421312:0:7198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226510 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.421325:0:7198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.421386:0:7198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226510 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.421402:0:7198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226510 expref: 29 pid: 5834 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940779.421417:0:7198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a042300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068557312:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940779.421538:0:7198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114fe540 going to sleep for 11 seconds 00000100:00100000:1.0:1788940779.430247:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940779.430479:0:7198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a042300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068557312:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940779.430518:0:7198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940779.430757:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036027008 00000100:00100000:3.0:1788940779.430769:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036027008 00000100:00100000:3.0:1788940779.431113:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 22 00000100:00100000:3.0:1788940779.431127:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+30:5602:x1875840036027008:12345-192.168.202.17@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788940779.431620:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+31:5602:x1875840036027008:12345-192.168.202.17@tcp:35:ldlm_bl.0 Request processed in 494us (1438us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788940779.431630:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 22 00000100:00100000:1.0:1788940779.451505:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940779.455177:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036027136 00000100:00100000:3.0:1788940779.455216:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036027136 00010000:00010000:3.0:1788940779.455289:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226510 expref: 31 pid: 5834 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940779.455355:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 48 00000100:00100000:3.0:1788940779.455369:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+31:2358:x1875840036027136:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940779.455411:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940779.455420:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226510 expref: 31 pid: 5834 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.455437:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226510 expref: 31 pid: 5834 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.455466:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa32df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226510 expref: 31 pid: 5834 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.455488:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4500) 00010000:00010000:3.0:1788940779.455494:0:7622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.455505:0:7622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.455514:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.455547:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940779.455641:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+30:2358:x1875840036027136:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 275us (4152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940779.455649:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 48 00010000:00010000:0.0:1788940779.461888:0:7198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.461913:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.461965:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.461974:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.461984:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.461991:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940779.461997:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.462007:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.462031:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4500) 00010000:00010000:0.0:1788940779.462035:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940779.462043:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.462049:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa333a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940779.462257:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+29:10499:x1875840036026752:12345-192.168.202.17@tcp:54:lfs.0 Request processed in 41113us (41718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940779.462292:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 93 00000100:00100000:1.0:1788940779.474345:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940779.474467:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036027392 00000100:00100000:0.0:1788940779.474487:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036027392 00000100:00100000:0.0:1788940779.474573:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 23 00000100:00100000:0.0:1788940779.474586:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+29:10499:x1875840036027392:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:0.0:1788940779.474964:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+30:10499:x1875840036027392:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 380us (638us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788940779.474974:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 23 00000100:00100000:3.0:1788940779.529605:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940779.529630:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068557440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940779.529765:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940779.532640:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068557440 00000100:00100000:1.0:1788940779.532657:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068557440 00000100:00100000:1.0:1788940779.532857:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788940779.532868:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875840068557440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940779.532912:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940779.533005:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101219880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875840068557440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (3240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940779.533012:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788940779.533398:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068557440:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788940779.533480:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940779.617061:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940779.617236:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036027648 00000100:00100000:2.0:1788940779.617254:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036027648 00000100:00100000:2.0:1788940779.617341:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 94 00000100:00100000:2.0:1788940779.617354:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+30:10510:x1875840036027648:12345-192.168.202.17@tcp:101:cat.0 00010000:00010000:2.0:1788940779.617398:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940779.617426:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3341 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22652c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.617518:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3348 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.617534:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3348 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.617546:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3348 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.617561:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa334f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.617568:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa334f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.617575:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa334f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.617954:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3356 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.617964:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.617972:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940779.617983:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788940779.618082:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3348 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618090:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3348 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618098:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3348 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618104:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940779.618108:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3348 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618116:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3348 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618129:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:2.0:1788940779.618131:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940779.618136:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3348 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618142:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3348 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618154:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa334f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618161:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa334f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618166:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa334f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618171:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940779.618180:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa334f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618231:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa334f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618241:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f41054d7400) 00010000:00010000:2.0:1788940779.618243:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940779.618246:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa334f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618252:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa334f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618297:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3341 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22652c expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618312:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22652c expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.618319:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4500) 00010000:00010000:2.0:1788940779.618322:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940779.618325:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6c00, rc 0) 00000100:00100000:2.0:1788940779.618416:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:10510:x1875840036027648:12345-192.168.202.17@tcp:101:cat.0 Request processed in 1064us (1371us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788940779.618424:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 94 00000100:00100000:1.0:1788940779.626040:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940779.626838:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036027904 00000100:00100000:3.0:1788940779.626849:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036027904 00000100:00100000:3.0:1788940779.626917:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 24 00000100:00100000:3.0:1788940779.626928:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:10510:x1875840036027904:12345-192.168.202.17@tcp:35:cat.0 00000100:00100000:3.0:1788940779.627377:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+33:10510:x1875840036027904:12345-192.168.202.17@tcp:35:cat.0 Request processed in 449us (1346us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788940779.627386:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 24 00000100:00100000:0.0:1788940779.665447:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940779.668014:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036028160 00000100:00100000:2.0:1788940779.668034:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036028160 00000100:00100000:2.0:1788940779.668138:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 95 00000100:00100000:2.0:1788940779.668151:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+33:10511:x1875840036028160:12345-192.168.202.17@tcp:36:rm.0 00010000:00010000:2.0:1788940779.668308:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788940779.668354:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3356 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22652c expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.668384:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa332c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226525 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.668399:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa32f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226517 expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.668414:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41129a4500) 00010000:00010000:2.0:1788940779.668430:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940779.668456:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3364 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.668473:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3364 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.668484:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3364 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.668513:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa336b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.668521:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa336b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.668528:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa336b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.671359:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3372 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.671385:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3372 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.671401:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3372 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940779.672310:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788940779.672345:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 420976138661ns, next at 421976135589ns, rc = 0 00010000:00010000:2.0:1788940779.672436:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3379 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672453:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3379 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672466:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3379 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672476:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3379 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672484:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3379 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672492:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3379 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672524:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940779.672554:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3372 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672571:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3372 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672579:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3372 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672587:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940779.672593:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3372 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672604:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3372 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.672612:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940779.672620:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41054d7300) 00010000:00010000:2.0:1788940779.672627:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788940779.672632:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3379 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672635:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3372 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672671:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3372 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.672672:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940779.672696:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3379 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672703:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3364 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.672711:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3379 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672713:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3364 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672735:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3364 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672754:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940779.672764:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3364 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.672767:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8f41054d7300) 00010000:00010000:3.0:1788940779.672780:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788940779.672780:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3364 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.672793:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3379 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672801:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:3.0:1788940779.672803:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3379 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672809:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940779.672818:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3364 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.672828:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3364 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940779.672842:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfbccfdb reply state 00000000443bbd94 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa336b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.672851:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940779.672855:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788940779.672857:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940779.672862:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940779.672996:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:10511:x1875840036028160:12345-192.168.202.17@tcp:36:rm.0 Request processed in 4839us (7559us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788940779.673008:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 95 00010000:00010000:0.0:1788940779.682834:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa336b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.682860:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa336b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.682870:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa336b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.682879:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940779.682885:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa336b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.682895:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa336b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.682917:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f41054d7400) 00010000:00010000:0.0:1788940779.682921:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940779.682946:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa336b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.682953:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa336b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940779.696010:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940779.696069:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940779.696267:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036028288 00000100:00100000:2.0:1788940779.696280:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036028288 00000100:00100000:2.0:1788940779.696364:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 297 00000100:00100000:2.0:1788940779.696376:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2361:x1875840036028288:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940779.696475:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2361:x1875840036028288:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 102us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940779.696484:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 297 00000100:00100000:0.0:1788940779.696968:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940779.704830:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940779.705040:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036028672 00000100:00100000:2.0:1788940779.705057:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036028672 00000100:00100000:2.0:1788940779.705228:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 155 00000100:00100000:2.0:1788940779.705241:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2361:x1875840036028672:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940779.705368:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2361:x1875840036028672:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 130us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940779.705376:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 155 00000100:00080000:0.0:1788940779.707376:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940779.708626:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036028544 00000100:00100000:3.0:1788940779.708647:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036028544 00000100:00100000:3.0:1788940779.708772:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036028416 00000100:00100000:3.0:1788940779.708777:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036028416 00000100:00080000:0.0:1788940779.708784:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940779.708814:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 83 00000100:00100000:0.0:1788940779.708821:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 84 00000100:00100000:3.0:1788940779.708825:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840036028544:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940779.708830:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2361:x1875840036028416:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940779.708931:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840036028544:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 108us (12861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940779.708939:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 83 00000100:00100000:0.0:1788940779.712657:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2361:x1875840036028416:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 3656us (15517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940779.712796:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 84 00000100:00100000:0.0:1788940779.776840:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940779.777031:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036028928 00000100:00100000:2.0:1788940779.777045:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036028928 00000100:00100000:2.0:1788940779.777103:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 96 00000100:00100000:2.0:1788940779.777113:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+31:10517:x1875840036028928:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:2.0:1788940779.777148:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940779.777177:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3380 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226533 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.777972:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3387 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.777992:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3387 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.778009:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3387 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.778029:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa338e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.778036:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa338e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.778043:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa338e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940779.779153:0:7198:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788940779.780168:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3395 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.780232:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.780248:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.780365:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3387 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.780374:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3387 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.780382:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3387 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.780389:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940779.780394:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3387 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.780403:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3387 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.780418:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:2.0:1788940779.780422:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940779.780428:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3387 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.780457:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3387 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940779.780478:0:7198:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b73fa8b reply state 00000000769dd2d0 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa338e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940779.780490:0:7198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788940779.780538:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3380 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226533 expref: 34 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.780718:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226533 expref: 33 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940779.780728:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f41054d7f00) 00010000:00010000:2.0:1788940779.780730:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940779.780733:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050c00, rc 0) 00000100:00100000:2.0:1788940779.780854:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+34:10517:x1875840036028928:12345-192.168.202.17@tcp:101:bash.0 Request processed in 3740us (4031us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788940779.780865:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 96 00000100:00100000:2.0:1788940779.785964:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940779.786548:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036029056 00000100:00100000:1.0:1788940779.786798:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036029056 00000100:00100000:1.0:1788940779.786887:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 34 00000100:00100000:1.0:1788940779.786899:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840036029056:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:1.0:1788940779.786927:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940779.786958:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22653a expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940779.786996:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940779.787028:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788940779.787033:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940779.787045:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22653a expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.787097:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22653a expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.787120:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5800, rc 0) 00000100:00100000:1.0:1788940779.787235:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840036029056:12345-192.168.202.17@tcp:101:bash.0 Request processed in 337us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940779.787243:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 34 00010000:00010000:3.0:1788940779.793182:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa338e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.803108:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa338e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.803118:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa338e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.803125:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940779.803132:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa338e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.803143:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa338e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.803166:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f41054d7700) 00010000:00010000:3.0:1788940779.803170:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940779.803177:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa338e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.803183:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa338e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940779.803776:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940779.803962:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036029184 00000100:00100000:1.0:1788940779.803975:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036029184 00000100:00100000:1.0:1788940779.805346:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 35 00000100:00100000:1.0:1788940779.805370:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:10517:x1875840036029184:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:1.0:1788940779.805406:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940779.805436:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226541 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.805488:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22653a expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.805498:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940779.805504:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940779.805511:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.805649:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22653a expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940779.805693:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22653a expref: 7 pid: 8426 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940779.805714:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1875840068557568:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940779.805914:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a62ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940779.811056:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940779.811226:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6671:1875840068557568:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940779.811273:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 7 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.811300:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5400, rc 0) 00000100:00100000:3.0:1788940779.811380:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036029312 00000100:00100000:3.0:1788940779.811391:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036029312 00000100:00100000:0.0:1788940779.811392:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:10517:x1875840036029184:12345-192.168.202.17@tcp:101:bash.0 Request processed in 6032us (7621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940779.811403:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 35 00010000:00010000:3.0:1788940779.811441:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22653a expref: 7 pid: 8426 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940779.811471:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 49 00000100:00100000:3.0:1788940779.811480:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41080e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036029312:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940779.811497:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940779.811528:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22653a expref: 7 pid: 8426 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.811544:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22653a expref: 7 pid: 8426 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.812230:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22653a expref: 7 pid: 8426 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.812249:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940779.812254:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940779.812262:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940779.812270:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940779.812391:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940779.812411:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111330000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5819:1875840068557696:192.168.202.17@tcp:105: 00000100:00100000:0.0:1788940779.812505:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114fe540 going to sleep for 11 seconds 00000100:00100000:0.0:1788940779.815573:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111330000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5819:1875840068557696:192.168.202.17@tcp:105: 00010000:00010000:0.0:1788940779.815610:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940779.815690:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41080e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840036029312:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 4210us (4647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940779.815702:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 49 00000100:00100000:2.0:1788940779.822123:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940779.822774:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036029568 00000100:00100000:3.0:1788940779.822789:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036029568 00000100:00100000:2.0:1788940779.823029:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 25 00000100:00100000:2.0:1788940779.823042:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+33:10517:x1875840036029568:12345-192.168.202.17@tcp:35:bash.0 00000100:00100000:2.0:1788940779.823559:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+34:10517:x1875840036029568:12345-192.168.202.17@tcp:35:bash.0 Request processed in 517us (1452us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788940779.823571:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 25 00000100:00100000:2.0:1788940780.021295:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.021769:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036029696 00000100:00100000:0.0:1788940780.021784:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036029696 00000100:00100000:0.0:1788940780.021862:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 97 00000100:00100000:0.0:1788940780.021876:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+34:10533:x1875840036029696:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940780.021908:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940780.021936:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226548 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.022024:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa33b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.022040:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa33b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.022054:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa33b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940780.022097:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788940780.022116:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940780.022139:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa33b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.022167:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226548 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.022275:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa33b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226548 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.022285:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:0.0:1788940780.022288:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940780.022293:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234200, rc 0) 00000100:00100000:0.0:1788940780.022376:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:10533:x1875840036029696:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 504us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940780.022384:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 97 00000100:00100000:1.0:1788940780.036026:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.036177:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036029952 00000100:00100000:0.0:1788940780.036234:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036029952 00000100:00100000:0.0:1788940780.036318:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 98 00000100:00100000:0.0:1788940780.036341:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:10533:x1875840036029952:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940780.036374:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940780.036407:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22654f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.036568:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa33c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.036589:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa33c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.036632:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa33c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940780.036651:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788940780.036832:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22654f expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.036858:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa33c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22654f expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.036869:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f41054d7f00) 00010000:00010000:0.0:1788940780.036873:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940780.036877:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235a00, rc 0) 00000100:00100000:0.0:1788940780.036976:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+37:10533:x1875840036029952:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 638us (967us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788940780.036984:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 98 00000100:00100000:2.0:1788940780.041642:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.041706:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.041851:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036030208 00000100:00100000:0.0:1788940780.041866:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036030208 00000100:00100000:0.0:1788940780.041946:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 99 00000100:00100000:0.0:1788940780.041961:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+37:10533:x1875840036030208:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940780.041996:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940780.042021:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226556 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.042146:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa33db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.042212:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa33db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.042228:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa33db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940780.042243:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788940780.042412:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226556 expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.042434:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa33db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226556 expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.042444:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f41054d7f00) 00010000:00010000:0.0:1788940780.042447:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788940780.042451:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235c00, rc 0) 00000100:00100000:0.0:1788940780.042536:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+39:10533:x1875840036030208:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 579us (909us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788940780.042544:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 99 00000100:00100000:3.0:1788940780.042719:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036030336 00000100:00100000:3.0:1788940780.042726:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036030336 00000100:00100000:3.0:1788940780.042788:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00100000:3.0:1788940780.042798:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f367800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+39:2358:x1875840036030336:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940780.042810:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940780.042828:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa33c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22654f expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.042839:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f41054d7f00) 00010000:00010000:3.0:1788940780.042843:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940780.042866:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f367800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+38:2358:x1875840036030336:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 71us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940780.042872:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00100000:3.0:1788940780.048168:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940780.048489:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036030464 00000100:00100000:1.0:1788940780.048507:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036030464 00000100:00100000:1.0:1788940780.048638:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 36 00000100:00100000:1.0:1788940780.048652:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2361:x1875840036030464:12345-192.168.202.17@tcp:1:lfs.0 00010000:00010000:1.0:1788940780.048731:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.048758:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.048768:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940780.048774:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940780.048779:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33e9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.048824:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 6 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.048864:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 6 pid: 6671 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940780.048883:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8426:1875840068557824:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940780.049003:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a62ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940780.052820:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8426:1875840068557824:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940780.053036:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.053367:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036030592 00000100:00100000:0.0:1788940780.053376:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036030592 00002000:00100000:0.0:1788940780.053431:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8f4101219c00 x1875840036030592/t0(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:1/0 lens 504/0 e 0 to 0 dl 1788940791 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788940780.053440:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f4101219c00 with x1875840036030592 ext(0->8) 00010000:00010000:0.0:1788940780.053449:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 7 pid: 6671 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.053484:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 7 pid: 6671 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940780.053490:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f4101219c00 00000100:00100000:0.0:1788940780.053523:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 1 00000100:00100000:0.0:1788940780.053531:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036030592:12345-192.168.202.17@tcp:4:lfs.0 00010000:00010000:2.0:1788940780.053774:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940780.054756:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2359:x1875840036030592:12345-192.168.202.17@tcp:4:lfs.0 Request processed in 1215us (1711us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788940780.054775:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 1 00002000:00100000:1.0:1788940780.054788:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8f4101219c00 x1875840036030592/t4294967302(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:1/0 lens 504/448 e 0 to 0 dl 1788940791 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940780.054796:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f4101219c00 with x1875840036030592 ext(0->8) 00010000:00010000:1.0:1788940780.054804:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 9 pid: 6671 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.054818:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 9 pid: 6671 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940780.054824:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f4101219c00 00000100:00100000:1.0:1788940780.056762:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.056913:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036030720 00000100:00100000:0.0:1788940780.056925:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036030720 00010000:00010000:0.0:1788940780.056972:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 9 pid: 6671 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940780.057024:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 50 00000100:00100000:0.0:1788940780.057035:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2358:x1875840036030720:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940780.057053:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788940780.057076:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788940780.057079:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788940778 00002000:00010000:0.0:1788940780.057081:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788940779 00002000:00010000:0.0:1788940780.057083:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788940778 00010000:00010000:0.0:1788940780.057089:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 9 pid: 6671 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.057103:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 9 pid: 6671 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.057156:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3440424/0xa1d8aa9164aa33aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226541 expref: 9 pid: 6671 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.057176:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940780.057182:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940780.057231:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.057243:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33e9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.057390:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940780.057454:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2358:x1875840036030720:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 420us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940780.057462:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 50 00010000:00010000:2.0:1788940780.057894:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.057905:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.057935:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.057944:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.057954:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.057962:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5800 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940780.057967:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.057993:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.058008:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.058016:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000253e2c03/0xa1d8aa9164aa33e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940780.058132:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2361:x1875840036030464:12345-192.168.202.17@tcp:1:lfs.0 Request processed in 9483us (9978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940780.058142:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 36 00000100:00100000:1.0:1788940780.061516:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.061557:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036030976 00000100:00100000:2.0:1788940780.061573:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036030976 00000100:00100000:2.0:1788940780.061703:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 26 00000100:00100000:2.0:1788940780.061716:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41057c5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+38:10533:x1875840036030976:12345-192.168.202.17@tcp:35:lfs.0 00000004:00010000:2.0:1788940780.061807:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa33db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226556 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940780.062143:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788940780.062212:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788940780.062615:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788940780.062681:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.062702:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3395 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226533 expref: 42 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.062734:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.062781:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226533 expref: 42 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.062801:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3395 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226533 expref: 42 pid: 7198 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940780.062821:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1875840068557952:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940780.062943:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410f6b4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940780.065854:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1875840068557952:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940780.065889:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940780.068352:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940780.068698:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036031104 00000100:00100000:3.0:1788940780.068713:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036031104 00010000:00010000:3.0:1788940780.068769:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3395 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226533 expref: 43 pid: 7198 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940780.068819:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 51 00000100:00100000:3.0:1788940780.068831:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+43:2358:x1875840036031104:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940780.068859:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940780.068882:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3395 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226533 expref: 43 pid: 7198 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.068897:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226533 expref: 43 pid: 7198 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.068925:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3395 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226533 expref: 43 pid: 7198 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.068944:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f41054d7f00) 00010000:00010000:3.0:1788940780.068949:0:7622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.068961:0:7622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.068969:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.069136:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940780.069241:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+42:2358:x1875840036031104:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 411us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940780.069250:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 51 00010000:00010000:2.0:1788940780.070528:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.070545:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940780.070873:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788940780.071142:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788940780.071474:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875840068558080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788940780.071568:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940780.071758:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410f6b40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940780.071882:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068558080 00000100:00100000:0.0:1788940780.071893:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068558080 00000100:00100000:0.0:1788940780.072021:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940780.072033:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875840068558080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788940780.072160:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875840068558080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 128us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940780.072168:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788940780.072224:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875840068558080:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1788940780.072322:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788940780.072781:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788940780.072861:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875840068558208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788940780.072897:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940780.072923:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410f6b4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940780.072950:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068558208 00000100:00100000:0.0:1788940780.072956:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068558208 00000100:00100000:0.0:1788940780.073040:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788940780.073050:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875840068558208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788940780.073247:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875840068558208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 199us (347us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788940780.073254:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788940780.073267:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875840068558208:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788940780.073321:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788940780.074067:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.074085:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.074093:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.074099:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940780.074104:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.074111:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.074129:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f41054d7f00) 00010000:00010000:2.0:1788940780.074132:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788940780.074137:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.074143:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa33f0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940780.074503:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788940780.074617:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788940780.074628:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 421378440119ns, next at 422378437849ns, rc = 0 00000001:00080000:2.0:1788940780.074638:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788940780.074690:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f41054d7f00) 00010000:00010000:2.0:1788940780.074694:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788940780.074703:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa33db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226556 expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940780.075055:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41057c5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+45:10533:x1875840036030976:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 13340us (13549us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788940780.075065:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 26 00000020:00080000:2.0:1788940780.075071:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788940780.080625:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.080724:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036031232 00000100:00100000:0.0:1788940780.080743:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036031232 00000100:00100000:0.0:1788940780.080805:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 100 00000100:00100000:0.0:1788940780.080816:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+45:10533:x1875840036031232:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940780.080839:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940780.080862:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa33f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22655d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.080925:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa33f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22655d expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.080954:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa33f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22655d expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.080973:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:0.0:1788940780.080977:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940780.080981:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234000, rc 0) 00000100:00100000:0.0:1788940780.081039:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+46:10533:x1875840036031232:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 225us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940780.081054:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 100 00000100:00100000:0.0:1788940780.088489:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940780.088588:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036031488 00000100:00100000:1.0:1788940780.088598:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036031488 00000100:00100000:1.0:1788940780.088732:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 27 00000100:00100000:1.0:1788940780.088743:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+46:10533:x1875840036031488:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:1.0:1788940780.089161:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+47:10533:x1875840036031488:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 418us (679us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788940780.089168:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 27 00010000:00010000:0.0:1788940780.104455:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940780.183659:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.183822:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036031616 00000100:00100000:0.0:1788940780.183834:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036031616 00000100:00100000:0.0:1788940780.183976:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 101 00000100:00100000:0.0:1788940780.183987:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+47:10543:x1875840036031616:12345-192.168.202.17@tcp:34:lfs.0 00010000:00010000:0.0:1788940780.184076:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184094:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184106:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184122:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184129:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184136:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184281:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa340c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184290:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa340c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184298:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa340c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940780.184354:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa340c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184367:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184380:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184386:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184393:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940780.184398:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184405:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184417:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:0.0:1788940780.184420:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940780.184425:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184431:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa33fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184444:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184451:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3405 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184457:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184463:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940780.184472:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184479:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3405 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184487:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f410ad9f600) 00010000:00010000:0.0:1788940780.184489:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940780.184492:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3405 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184498:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3405 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184512:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa340c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184518:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa340c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184523:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa340c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184528:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940780.184530:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa340c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184535:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa340c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184540:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:0.0:1788940780.184542:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940780.184550:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa340c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.184555:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa340c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940780.184640:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+47:10543:x1875840036031616:12345-192.168.202.17@tcp:34:lfs.0 Request processed in 654us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940780.184649:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 101 00000100:00100000:0.0:1788940780.247304:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.247478:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036031872 00000100:00100000:2.0:1788940780.247490:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036031872 00000100:00100000:2.0:1788940780.247555:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 102 00000100:00100000:2.0:1788940780.247567:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+47:10546:x1875840036031872:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940780.247589:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940780.247610:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3413 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226564 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.247713:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa341a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.247729:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa341a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.247753:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa341a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.247770:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3421 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.247784:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.247791:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.247911:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa3428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.247919:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa3428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.247926:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa3428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940780.247948:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788940780.248042:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa341a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248050:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa341a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248056:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa341a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248062:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940780.248066:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa341a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248074:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa341a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248096:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:2.0:1788940780.248100:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940780.248106:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa341a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248113:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa341a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248128:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248135:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3421 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248140:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3421 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248146:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940780.248149:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3421 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248155:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3421 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248162:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f41054d7f00) 00010000:00010000:2.0:1788940780.248163:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940780.248166:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3421 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248172:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3421 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248286:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3413 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226564 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248300:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa3428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226564 expref: 49 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.248306:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:2.0:1788940780.248309:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940780.248311:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050a00, rc 0) 00000100:00100000:2.0:1788940780.248383:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+49:10546:x1875840036031872:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 818us (1089us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788940780.248391:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 102 00000100:00100000:1.0:1788940780.253670:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.254000:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036032000 00000100:00100000:2.0:1788940780.254010:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036032000 00000100:00100000:2.0:1788940780.254050:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 103 00000100:00100000:2.0:1788940780.254056:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+49:10546:x1875840036032000:12345-192.168.202.17@tcp:54:lfs.0 00010000:00010000:2.0:1788940780.254115:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3436 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.254129:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.254137:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.254160:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.254183:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3436 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.254214:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.254220:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940780.254225:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.254234:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3436 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.254246:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:2.0:1788940780.254248:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940780.254253:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3436 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.254257:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3436 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940780.254340:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+49:10546:x1875840036032000:12345-192.168.202.17@tcp:54:lfs.0 Request processed in 283us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940780.254349:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 103 00000100:00100000:1.0:1788940780.260989:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.261135:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036032256 00000100:00100000:2.0:1788940780.261146:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036032256 00000100:00100000:2.0:1788940780.261270:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 28 00000100:00100000:2.0:1788940780.261281:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+49:10546:x1875840036032256:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:2.0:1788940780.261569:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+50:10546:x1875840036032256:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 289us (591us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788940780.261589:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 28 00000100:00100000:1.0:1788940780.346944:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.347162:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036032512 00000100:00100000:2.0:1788940780.347173:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036032512 00000100:00100000:2.0:1788940780.347265:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 104 00000100:00100000:2.0:1788940780.347276:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+50:10556:x1875840036032512:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:2.0:1788940780.347315:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940780.347318:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788940780.347354:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234200/0xa1d8aa9164aa33b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226548 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.347374:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:2.0:1788940780.347380:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940780.347394:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa343d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22656b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.347801:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.347815:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa3428 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226564 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.347823:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.347853:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa3428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226564 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.347866:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa3428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226564 expref: 50 pid: 5833 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940780.347894:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f873480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875840068558336:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940780.348710:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410f6b4600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940780.357557:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.357632:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f873480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875840068558336:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940780.357635:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036032640 00000100:00100000:3.0:1788940780.357649:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036032640 00010000:00010000:2.0:1788940780.357671:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.357711:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa3428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226564 expref: 51 pid: 5833 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940780.357798:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 52 00000100:00100000:3.0:1788940780.357811:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111331180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+51:2358:x1875840036032640:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940780.357833:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940780.357841:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa3428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226564 expref: 51 pid: 5833 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.357870:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa3428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226564 expref: 51 pid: 5833 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.357900:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa3428 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226564 expref: 51 pid: 5833 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.357918:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:3.0:1788940780.357924:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.357936:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.357945:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.357977:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940780.358039:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.358061:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940780.358086:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788940780.358296:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa343d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22656b expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.358316:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22656b expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.358336:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:2.0:1788940780.358339:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788940780.358343:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050400, rc 0) 00000100:00100000:3.0:1788940780.362603:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111331180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+51:2358:x1875840036032640:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 4775us (5045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940780.362622:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 52 00000100:00100000:2.0:1788940780.371665:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+50:10556:x1875840036032512:12345-192.168.202.17@tcp:101:bash.0 Request processed in 24378us (24726us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788940780.371689:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 104 00000100:00100000:0.0:1788940780.379096:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.379224:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036032896 00000100:00100000:2.0:1788940780.379264:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036032896 00000100:00100000:2.0:1788940780.379341:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 105 00000100:00100000:2.0:1788940780.379353:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+50:10556:x1875840036032896:12345-192.168.202.17@tcp:36:bash.0 00010000:00010000:2.0:1788940780.379797:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3452 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.379821:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.379836:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940780.379903:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788940780.379930:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000251d6aae reply state 0000000057fafb00 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940780.379940:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940780.380065:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+53:10556:x1875840036032896:12345-192.168.202.17@tcp:36:bash.0 Request processed in 713us (982us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788940780.380074:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 105 00000020:00080000:2.0:1788940780.380080:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788940780.385277:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.385709:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036033024 00000100:00100000:2.0:1788940780.385724:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036033024 00000100:00100000:2.0:1788940780.385807:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 106 00000100:00100000:2.0:1788940780.385820:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+53:10556:x1875840036033024:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:2.0:1788940780.385853:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940780.385880:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3459 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226572 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.386117:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.386159:0:7198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22656b expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.386169:0:7198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3452 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.386176:0:7198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.386450:0:7198:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.386540:0:7198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22656b expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.386556:0:7198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22656b expref: 54 pid: 5833 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940780.386571:0:7198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f2d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068558464:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940780.386616:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.386630:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3452 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.386639:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3452 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.386646:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940780.386650:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3452 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.386659:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3452 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940780.386747:0:7198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a62b300 going to sleep for 11 seconds 00010000:00010000:0.0:1788940780.386748:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:0.0:1788940780.386755:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940780.386759:0:3287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.386790:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3452 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.386797:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa3452 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940780.389876:0:7198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f2d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068558464:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940780.389915:0:7198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940780.390714:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.390818:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036033152 00000100:00100000:0.0:1788940780.390829:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036033152 00010000:00010000:0.0:1788940780.390877:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22656b expref: 54 pid: 5833 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940780.390917:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 53 00000100:00100000:0.0:1788940780.390927:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+54:2359:x1875840036033152:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940780.390946:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940780.390954:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22656b expref: 54 pid: 5833 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.390968:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22656b expref: 54 pid: 5833 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.390993:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3444 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22656b expref: 54 pid: 5833 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.391030:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:0.0:1788940780.391036:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.391047:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.391057:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.391090:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940780.391662:0:7198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.391671:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940780.391734:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788940780.391747:0:7198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940780.391771:0:7198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.391807:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3459 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226572 expref: 54 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.391824:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226572 expref: 53 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.391833:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:1.0:1788940780.391836:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940780.391839:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142051c00, rc 0) 00000100:00100000:0.0:1788940780.392419:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+53:2359:x1875840036033152:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 1490us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940780.392429:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 53 00000100:00100000:1.0:1788940780.392562:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+52:10556:x1875840036033024:12345-192.168.202.17@tcp:101:bash.0 Request processed in 6744us (7312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940780.392570:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 106 00000100:00100000:1.0:1788940780.396452:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.396548:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036033408 00000100:00100000:0.0:1788940780.396560:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036033408 00000100:00100000:0.0:1788940780.396626:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 29 00000100:00100000:0.0:1788940780.396639:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+52:10556:x1875840036033408:12345-192.168.202.17@tcp:35:bash.0 00000100:00100000:0.0:1788940780.396936:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+53:10556:x1875840036033408:12345-192.168.202.17@tcp:35:bash.0 Request processed in 299us (497us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788940780.396945:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 29 00000100:00100000:2.0:1788940780.485407:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.485541:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036033536 00000100:00100000:0.0:1788940780.485557:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036033536 00000100:00100000:0.0:1788940780.485644:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 107 00000100:00100000:0.0:1788940780.485660:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+53:10562:x1875840036033536:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940780.485807:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940780.485871:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa3467 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226579 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.485959:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa346e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.485976:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa346e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.485989:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa346e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940780.486033:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788940780.486037:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940780.486058:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa346e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.486086:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa3467 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226579 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.486110:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa346e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226579 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.486120:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:0.0:1788940780.486124:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940780.486129:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235c00, rc 0) 00000100:00100000:0.0:1788940780.486265:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+54:10562:x1875840036033536:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 610us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940780.486273:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 107 00000100:00100000:1.0:1788940780.492599:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940780.492682:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036033664 00000100:00100000:3.0:1788940780.492714:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036033664 00000100:00100000:3.0:1788940780.492787:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 108 00000100:00100000:3.0:1788940780.492799:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+54:10562:x1875840036033664:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:3.0:1788940780.492826:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940780.492865:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3475 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226580 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.492946:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa347c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.492964:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa347c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.492977:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa347c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.492996:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493004:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493011:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493124:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa348a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493132:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa348a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493140:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa348a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940780.493216:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788940780.493221:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940780.493242:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa348a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493266:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa348a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493276:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa347c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493283:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa347c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493290:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa347c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493297:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940780.493303:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa347c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493311:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa347c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493333:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:3.0:1788940780.493336:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940780.493342:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa347c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493349:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa347c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493378:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493385:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3483 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493390:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493396:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940780.493399:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493406:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3483 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493413:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f4112cbfe00) 00010000:00010000:3.0:1788940780.493414:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940780.493416:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3483 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493422:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3483 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493454:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3475 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226580 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493468:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa348a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226580 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.493486:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:3.0:1788940780.493488:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940780.493491:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36000, rc 0) 00000100:00100000:3.0:1788940780.493571:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:10562:x1875840036033664:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 773us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940780.493579:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 108 00000100:00100000:1.0:1788940780.497626:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.498030:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036034048 00000100:00100000:0.0:1788940780.498067:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036034048 00000100:00100000:1.0:1788940780.498079:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.498220:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036033920 00000100:00100000:2.0:1788940780.498226:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036033920 00000100:00100000:0.0:1788940780.498228:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:0.0:1788940780.498240:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:2359:x1875840036034048:12345-192.168.202.17@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788940780.498259:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 109 00000100:00100000:2.0:1788940780.498266:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:10562:x1875840036033920:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940780.498282:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940780.498288:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940780.498309:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3491 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226587 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.498310:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa348a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226580 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.498345:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:0.0:1788940780.498352:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940780.498418:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:2359:x1875840036034048:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 180us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940780.498426:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 7 00010000:00010000:2.0:1788940780.498443:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.500137:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226572 expref: 55 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.500151:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.500225:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226572 expref: 55 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.500265:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226572 expref: 55 pid: 7198 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940780.500284:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f872d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875840068558592:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940780.500413:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410f6b4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940780.504025:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.504351:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036034176 00000100:00100000:0.0:1788940780.504364:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036034176 00010000:00010000:0.0:1788940780.504419:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226572 expref: 56 pid: 7198 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940780.504451:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f872d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875840068558592:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940780.504469:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 54 00000100:00100000:0.0:1788940780.504479:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41080e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:2358:x1875840036034176:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940780.504483:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.504498:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940780.504506:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226572 expref: 56 pid: 7198 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.504520:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226572 expref: 56 pid: 7198 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.504547:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226572 expref: 56 pid: 7198 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.504584:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:0.0:1788940780.504589:0:7622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.504600:0:7622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.504619:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940780.504648:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940780.504721:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41080e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:2358:x1875840036034176:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 242us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940780.504729:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 54 00010000:00010000:2.0:1788940780.505222:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.505231:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940780.505257:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788940780.505467:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3491 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226587 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.505486:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226587 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.505493:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:2.0:1788940780.505496:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788940780.505499:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050e00, rc 0) 00000100:00100000:2.0:1788940780.505589:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:10562:x1875840036033920:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 7323us (7509us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788940780.505613:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 109 00000100:00100000:1.0:1788940780.516544:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940780.516649:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036034432 00000100:00100000:3.0:1788940780.516665:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036034432 00000100:00100000:3.0:1788940780.516773:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 8 00000100:00100000:3.0:1788940780.516785:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:10562:x1875840036034432:12345-192.168.202.17@tcp:103:lfs.0 00010000:00010000:3.0:1788940780.516803:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940780.516836:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa33f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22655d expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.516859:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:3.0:1788940780.516866:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940780.516938:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+54:10562:x1875840036034432:12345-192.168.202.17@tcp:103:lfs.0 Request processed in 156us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940780.516947:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 8 00000100:00100000:3.0:1788940780.519527:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.524269:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036034560 00000100:00100000:2.0:1788940780.524294:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036034560 00000100:00100000:2.0:1788940780.524390:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 110 00000100:00100000:2.0:1788940780.524403:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+54:10562:x1875840036034560:12345-192.168.202.17@tcp:58:lfs.0 00010000:00010000:2.0:1788940780.524559:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa34a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.524582:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa34a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.524596:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa34a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940780.527586:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788940780.527913:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+54:10562:x1875840036034560:12345-192.168.202.17@tcp:58:lfs.0 Request processed in 3504us (8389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940780.527926:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 110 00000100:00100000:0.0:1788940780.530735:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.530938:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036034688 00000100:00100000:2.0:1788940780.530952:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036034688 00000100:00100000:2.0:1788940780.531038:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 111 00000100:00100000:2.0:1788940780.531051:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+54:10562:x1875840036034688:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940780.531079:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940780.531106:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa34ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22658e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.531181:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa34a6 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.531249:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa34ad lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22658e expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.531273:0:5835:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa34a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.531291:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa34ad lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22658e expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.531306:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:2.0:1788940780.531310:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940780.531314:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa34ad lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22658e expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.531334:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050c00, rc 0) 00000100:00100000:2.0:1788940780.531403:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:10562:x1875840036034688:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 354us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940780.531411:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 111 00000040:00080000:2.0:1788940780.872551:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788940780.872564:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940780.873807:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788940780.873826:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788940780.874270:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f872d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875840068558720:192.168.202.17@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788940780.874478:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410f6b4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940780.893086:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f872d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875840068558720:192.168.202.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788940780.895221:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.895576:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036034816 00000100:00100000:0.0:1788940780.895590:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036034816 00000100:00100000:0.0:1788940780.895678:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 112 00000100:00100000:0.0:1788940780.895691:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:10563:x1875840036034816:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788940780.895746:0:7198:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788940780.896378:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:10563:x1875840036034816:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 Request processed in 686us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940780.896389:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 112 00000100:00100000:0.0:1788940780.914966:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.915039:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036034944 00000100:00100000:2.0:1788940780.915063:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036034944 00000100:00100000:2.0:1788940780.915120:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 113 00000100:00100000:2.0:1788940780.915131:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:10563:x1875840036034944:12345-192.168.202.17@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788940780.915239:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34b4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915257:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915272:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915335:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915341:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915346:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915362:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa34c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915367:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa34c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915372:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa34c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940780.915404:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788940780.915407:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940780.915422:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa34c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915430:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915444:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34b4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915449:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915453:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940780.915456:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915461:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34b4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915470:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9fd00) 00010000:00010000:2.0:1788940780.915472:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940780.915476:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915480:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915490:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915494:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34bb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915497:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915505:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940780.915507:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915510:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34bb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915514:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8f41054d7f00) 00010000:00010000:2.0:1788940780.915515:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940780.915517:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34bb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915520:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915529:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa34c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915532:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa34c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915536:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa34c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915539:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940780.915541:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa34c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915544:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa34c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915555:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:2.0:1788940780.915557:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940780.915565:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa34c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.915569:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa34c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940780.915946:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:10563:x1875840036034944:12345-192.168.202.17@tcp:34:lhsmtool_posix.0 Request processed in 812us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940780.915954:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 113 00000100:00100000:1.0:1788940780.923133:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.923227:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036035200 00000100:00100000:2.0:1788940780.923238:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036035200 00000100:00100000:2.0:1788940780.923290:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 114 00000100:00100000:2.0:1788940780.923297:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:10563:x1875840036035200:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940780.923330:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940780.923352:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa34c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226595 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.923459:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.923471:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.923479:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940780.923487:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788940780.923592:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.923598:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.923602:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.923606:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940780.923609:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.923614:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.923623:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:2.0:1788940780.923626:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788940780.923630:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.923636:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.923675:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa34c9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226595 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.923683:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9fd00) 00010000:00010000:2.0:1788940780.923684:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940780.923687:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa34c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226595 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.923703:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142051c00, rc 0) 00000100:00100000:2.0:1788940780.923753:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:10563:x1875840036035200:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 456us (630us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788940780.923761:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 114 00000100:00100000:3.0:1788940780.931631:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.932053:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036035328 00000100:00100000:0.0:1788940780.932064:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036035328 00000100:00100000:0.0:1788940780.932123:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 115 00000100:00100000:0.0:1788940780.932250:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:10563:x1875840036035328:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788940780.932289:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788940780.932402:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:10563:x1875840036035328:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 Request processed in 256us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940780.932427:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 115 00000100:00100000:0.0:1788940780.939173:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940780.939370:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036035584 00000100:00100000:1.0:1788940780.939383:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036035584 00000100:00100000:1.0:1788940780.939449:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 116 00000100:00100000:1.0:1788940780.939459:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:10563:x1875840036035584:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940780.939481:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940780.939497:0:7198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788940780.939529:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa346e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226579 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.939550:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:1.0:1788940780.939556:0:7198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940780.939570:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa34de lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22659c expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940780.939963:0:7198:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788940780.940723:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa34e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.940738:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa34e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.940748:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa34e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.940801:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa34de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22659c expref: 58 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.940817:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa34e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22659c expref: 57 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.940825:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f41129a4c00) 00010000:00010000:1.0:1788940780.940828:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940780.940830:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4e00, rc 0) 00000100:00100000:1.0:1788940780.941071:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+57:10563:x1875840036035584:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 1607us (1911us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788940780.941094:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 116 00000100:00100000:1.0:1788940780.949054:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.949118:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036035840 00000100:00100000:2.0:1788940780.949129:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036035840 00000100:00100000:2.0:1788940780.949230:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 117 00000100:00100000:2.0:1788940780.949244:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+57:10563:x1875840036035840:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788940780.949330:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940780.949359:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa34e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22659c expref: 57 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949380:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f41129a4c00) 00010000:00010000:2.0:1788940780.949391:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940780.949410:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949423:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949443:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949493:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa8946909 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949501:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa8946909 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949523:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa8946909 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949600:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949607:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949614:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949620:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940780.949624:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949630:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949638:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:2.0:1788940780.949641:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940780.949645:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949651:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa34f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949660:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa8946909 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949667:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa8946909 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949680:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa8946909 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949686:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940780.949689:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa8946909 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949695:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa8946909 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949703:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa8946909 (ffff8f41054d7f00) 00010000:00010000:2.0:1788940780.949705:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940780.949708:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa8946909 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.949713:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa34fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa8946909 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940780.949792:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:10563:x1875840036035840:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 551us (748us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940780.949799:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 117 00000100:00100000:2.0:1788940780.952897:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940780.952975:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036035968 00000100:00100000:3.0:1788940780.952994:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036035968 00000100:00100000:3.0:1788940780.953085:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 118 00000100:00100000:3.0:1788940780.953099:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:10563:x1875840036035968:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940780.953146:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940780.953177:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3501 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2265a3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.953341:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.953361:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.953377:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.953502:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265a3 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.953525:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265a3 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.953534:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:3.0:1788940780.953537:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788940780.953541:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37e00, rc 0) 00000100:00100000:3.0:1788940780.953838:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+57:10563:x1875840036035968:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 741us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940780.953847:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 118 00000100:00100000:0.0:1788940780.963381:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940780.963813:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036036224 00000100:00100000:2.0:1788940780.963826:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036036224 00000100:00100000:2.0:1788940780.963893:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 119 00000100:00100000:2.0:1788940780.963904:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+57:10563:x1875840036036224:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788940780.964005:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa350f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.964041:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa350f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940780.964053:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa350f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940780.964364:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788940780.964375:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 422268187129ns, next at 423268184024ns, rc = 0 00000004:00010000:2.0:1788940780.964578:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051404776 reply state 0000000027d02475 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa350f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940780.964588:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940780.964700:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+59:10563:x1875840036036224:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 796us (1329us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788940780.964707:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 119 00010000:00010000:3.0:1788940780.966368:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa350f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.966393:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa350f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.966419:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa350f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.966427:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940780.966433:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa350f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.966442:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa350f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.966462:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:3.0:1788940780.966465:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788940780.966470:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa350f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940780.966478:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa350f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940780.981509:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940780.981606:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036036352 00000100:00100000:1.0:1788940780.981794:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036036352 00000100:00100000:1.0:1788940780.981857:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 120 00000100:00100000:1.0:1788940780.981865:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+58:10563:x1875840036036352:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940780.981884:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940780.981901:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3516 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2265aa expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.981963:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3516 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265aa expref: 59 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.981975:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3516 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265aa expref: 59 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940780.981988:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:1.0:1788940780.981991:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940780.981994:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4c00, rc 0) 00000100:00100000:1.0:1788940780.982098:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+59:10563:x1875840036036352:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 234us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940780.982104:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 120 00000100:00100000:1.0:1788940780.998305:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940780.998633:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036036480 00000100:00100000:0.0:1788940780.998643:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036036480 00000100:00100000:0.0:1788940780.998734:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 37 00000100:00100000:0.0:1788940780.998745:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2358:x1875840036036480:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788940780.999051:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2358:x1875840036036480:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 Request processed in 307us (755us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788940780.999059:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 37 00000100:00100000:2.0:1788940781.003340:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940781.003583:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036036736 00000100:00100000:0.0:1788940781.003592:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036036736 00000100:00100000:0.0:1788940781.003707:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 30 00000100:00100000:0.0:1788940781.003718:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+59:10563:x1875840036036736:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788940781.003932:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:10563:x1875840036036736:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 Request processed in 216us (599us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788940781.003940:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 30 00000100:00080000:3.0:1788940781.004326:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940781.016146:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940781.016275:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036036992 00000100:00100000:0.0:1788940781.016293:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036036992 00000100:00100000:0.0:1788940781.016428:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 121 00000100:00100000:0.0:1788940781.016439:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:10563:x1875840036036992:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788940781.016583:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:10563:x1875840036036992:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 146us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940781.016590:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 121 00000100:00100000:2.0:1788940781.018655:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940781.018794:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036037120 00000100:00100000:3.0:1788940781.018802:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036037120 00000100:00100000:3.0:1788940781.018913:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 122 00000100:00100000:3.0:1788940781.018923:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:10563:x1875840036037120:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940781.018941:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940781.018962:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa351d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2265b1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.019054:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.019077:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.019088:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940781.019125:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940781.019142:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.019165:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa351d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265b1 expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.019182:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265b1 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.019245:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:3.0:1788940781.019248:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788940781.019261:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36e00, rc 0) 00000100:00100000:3.0:1788940781.019325:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+61:10563:x1875840036037120:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 393us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940781.019337:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 122 00000100:00100000:2.0:1788940781.025804:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940781.033457:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036037248 00000100:00100000:0.0:1788940781.033473:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036037248 00000100:00100000:0.0:1788940781.033555:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 38 00000100:00100000:0.0:1788940781.033566:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2359:x1875840036037248:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940781.033583:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940781.033605:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa352b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2265b8 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940781.033645:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa111ec, blocks: 0x1 00010000:00010000:0.0:1788940781.033665:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=422s v=(0 0) 00010000:00010000:0.0:1788940781.033670:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940781.033679:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa352b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265b8 expref: 10 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.033697:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa352b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265b8 expref: 10 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.033709:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235c00, rc 0) 00000100:00100000:0.0:1788940781.033770:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:2359:x1875840036037248:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 208us (7977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940781.033776:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 38 00000100:00080000:3.0:1788940781.036221:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940781.038087:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940781.038323:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036037504 00000100:00100000:1.0:1788940781.038339:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036037504 00000100:00100000:1.0:1788940781.038406:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 123 00000100:00100000:1.0:1788940781.038415:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+61:10563:x1875840036037504:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788940781.038559:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+61:10563:x1875840036037504:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 144us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940781.038566:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 123 00000100:00100000:0.0:1788940781.053043:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940781.053246:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036037632 00000100:00100000:3.0:1788940781.053261:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036037632 00000100:00100000:3.0:1788940781.053340:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 39 00000100:00100000:3.0:1788940781.053352:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:10563:x1875840036037632:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940781.053386:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940781.053412:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3532 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2265bf expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.053456:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa352b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265b8 expref: 11 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.053466:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940781.053472:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940781.053478:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3532 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265bf expref: 11 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.053526:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa352b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265b8 expref: 11 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.053542:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa352b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265b8 expref: 11 pid: 6673 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940781.053558:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6674:1875840068558848:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940781.053895:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1eaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940781.056550:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6674:1875840068558848:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940781.056611:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3532 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265bf expref: 11 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.056638:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36600, rc 0) 00000100:00100000:0.0:1788940781.056726:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+11:10563:x1875840036037632:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 3374us (3696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940781.056737:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 39 00000100:00100000:0.0:1788940781.063131:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940781.063357:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036037760 00000100:00100000:1.0:1788940781.063369:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036037760 00010000:00010000:1.0:1788940781.063417:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa352b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265b8 expref: 11 pid: 6673 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940781.063462:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 55 00000100:00100000:1.0:1788940781.063474:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+11:2358:x1875840036037760:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940781.063490:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940781.063514:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa352b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265b8 expref: 11 pid: 6673 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.063529:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa352b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265b8 expref: 11 pid: 6673 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.063551:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa352b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265b8 expref: 11 pid: 6673 timeout: 522 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.063568:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940781.063573:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940781.063581:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265bf expref: 10 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.063629:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265bf expref: 10 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.063673:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265bf expref: 10 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940781.063695:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5817:1875840068558976:192.168.202.17@tcp:105: 00000100:00100000:1.0:1788940781.063782:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a62b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788940781.070401:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5817:1875840068558976:192.168.202.17@tcp:105: 00010000:00010000:1.0:1788940781.070436:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940781.070495:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:2358:x1875840036037760:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 7022us (7374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940781.070506:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 55 00000100:00100000:3.0:1788940781.076685:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940781.076829:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036037888 00000100:00100000:2.0:1788940781.076841:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036037888 00002000:00100000:2.0:1788940781.076959:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8f413508d880 x1875840036037888/t0(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:2/0 lens 504/0 e 0 to 0 dl 1788940792 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940781.076973:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f413508d880 with x1875840036037888 ext(0->12) 00002000:00010000:2.0:1788940781.076980:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f413508d880 00000100:00100000:2.0:1788940781.077018:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 2 00000100:00100000:2.0:1788940781.077029:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:2358:x1875840036037888:12345-192.168.202.17@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788940781.080381:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+12:2358:x1875840036037888:12345-192.168.202.17@tcp:4:lhsmtool_posix.0 Request processed in 3192us (3551us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788940781.080399:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 2 00002000:00100000:2.0:1788940781.080415:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8f413508d880 x1875840036037888/t4294967308(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:2/0 lens 504/448 e 0 to 0 dl 1788940792 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788940781.080427:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f413508d880 with x1875840036037888 ext(0->12) 00002000:00010000:2.0:1788940781.080434:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f413508d880 00000100:00100000:0.0:1788940781.087827:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940781.088879:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036038016 00000100:00100000:1.0:1788940781.088892:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036038016 00000100:00100000:1.0:1788940781.089023:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 124 00000100:00100000:1.0:1788940781.089034:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+61:10563:x1875840036038016:12345-192.168.202.17@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1788940781.129173:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788940781.176419:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:1.0:1788940781.176468:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f413a7b9a80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788940781.176474:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f410f6dde00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f413a7b9480 00000020:00080000:1.0:1788940781.176477:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f410f6dd700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f41412e7000 00000004:00080000:1.0:1788940781.176496:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:1.0:1788940781.176521:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788940781.176546:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f410f6b40c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788940781.176549:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f410f571500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f410f6b4780 00000020:00080000:1.0:1788940781.176552:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f410f571e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f41168a4c00 00000004:00080000:1.0:1788940781.176570:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788940781.176982:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788940781.177227:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788940781.177340:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940781.177359:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068559104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788940781.177432:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940781.177499:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068559104 00000100:00100000:3.0:1788940781.177507:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068559104 00000100:00100000:3.0:1788940781.177553:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788940781.177563:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875840068559104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788940781.177589:0:6673:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1788940781.177622:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa111ea, atime: 0x6aa111eb, ctime: 0x6aa111ea, blocks: 0x1 00010000:00010000:3.0:1788940781.177630:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3539 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.177646:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788940781.177650:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940781.177657:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.177673:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.177684:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3539 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.177694:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.177712:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788940781.178117:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1875840068559104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 554us (684us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788940781.178134:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788940781.178159:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940781.178165:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.178174:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36800 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940781.178179:0:7620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3539 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.178213:0:7620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3539 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.178229:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3539 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.178236:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3539 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.178255:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940781.178256:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940781.178258:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788940781.178287:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f413508df80/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788940781.178293:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068559104:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788940781.178401:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:10563:x1875840036038016:12345-192.168.202.17@tcp:44:lhsmtool_posix.0 Request processed in 89366us (90791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940781.178410:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 124 00000100:00100000:1.0:1788940781.179213:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41115af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068559232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788940781.179258:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940781.179296:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940781.179301:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41115af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068559360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788940781.179336:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940781.179574:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068559232 00000100:00100000:2.0:1788940781.179581:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068559232 00000100:00100000:2.0:1788940781.179632:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068559360 00000100:00100000:2.0:1788940781.179636:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068559360 00000100:00100000:2.0:1788940781.179654:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788940781.179662:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1875840068559232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788940781.179721:0:6671:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1788940781.179743:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3540 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.179764:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa32fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22651e expref: 11 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.179772:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788940781.179776:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940781.179780:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3540 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.179808:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa32fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22651e expref: 11 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.179834:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa32fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22651e expref: 11 pid: 8426 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940781.179846:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41115adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1875840068559488:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940781.179900:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940781.179915:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788940781.179923:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1875840068559360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788940781.180053:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788940781.180058:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788940780 00002000:00010000:2.0:1788940781.180060:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788940781.180062:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788940780 -> 1788940780 00002000:00010000:2.0:1788940781.180064:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:1.0:1788940781.180332:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940781.180466:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3303:x1875840068559360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 541us (1126us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788940781.180474:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1788940781.180515:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f41115af800/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788940781.180521:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41115af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068559360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788940781.184920:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940781.185049:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41115adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1875840068559488:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940781.185076:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3540 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940781.185355:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036038144 00000100:00100000:1.0:1788940781.185364:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036038144 00000100:00100000:1.0:1788940781.185421:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 43 00000100:00100000:1.0:1788940781.185431:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+12:2358:x1875840036038144:12345-192.168.202.17@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788940781.196987:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940781.199225:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036038272 00000100:00100000:3.0:1788940781.199240:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036038272 00010000:00010000:3.0:1788940781.199284:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa32fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22651e expref: 13 pid: 8426 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940781.199355:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 56 00000100:00100000:3.0:1788940781.199366:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:2359:x1875840036038272:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940781.199381:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940781.199387:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa32fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22651e expref: 13 pid: 8426 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.199400:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa32fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22651e expref: 13 pid: 8426 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.199423:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa32fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22651e expref: 13 pid: 8426 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.199439:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940781.199444:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940781.199450:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.199459:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3540 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.199486:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940781.199562:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+12:2359:x1875840036038272:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 197us (2584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940781.199570:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 56 00010000:00010000:2.0:1788940781.200570:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.200597:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.200607:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3540 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.200614:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3540 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.200639:0:6671:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940781.201300:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940781.201309:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3540 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.201331:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940781.201337:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3540 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.201346:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3540 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.201364:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3540 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.201384:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3540 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.201403:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940781.201405:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940781.201406:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940781.203819:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3303:x1875840068559232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24150us (24552us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788940781.203831:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1788940781.203890:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f41115af480/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788940781.203897:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41115af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068559232:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788940781.249504:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:1.0:1788940781.249695:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+11:2358:x1875840036038144:12345-192.168.202.17@tcp:16:lhsmtool_posix.0 Request processed in 64257us (64778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940781.249707:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 43 00000001:00080000:3.0:1788940781.250091:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788940781.250097:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1788940781.258683:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940781.258767:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036038528 00000100:00100000:1.0:1788940781.258778:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036038528 00000100:00100000:1.0:1788940781.258838:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 125 00000100:00100000:1.0:1788940781.258848:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:10563:x1875840036038528:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788940781.258897:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940781.258921:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa3524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265b1 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.258940:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:1.0:1788940781.258959:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940781.258992:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3547 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.259005:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3547 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.259016:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3547 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940781.259287:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f7ba637 reply state 000000008b5739a0 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3547 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940781.259297:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940781.259501:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:10563:x1875840036038528:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 653us (826us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788940781.259576:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 125 00010000:00010000:2.0:1788940781.272462:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3547 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.272481:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3547 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.272488:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3547 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.272495:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940781.272500:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3547 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.272590:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3547 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.272607:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:2.0:1788940781.272610:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940781.272615:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3547 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.272621:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3547 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940781.274953:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940781.275049:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036038656 00000100:00100000:1.0:1788940781.275060:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036038656 00000100:00100000:1.0:1788940781.275120:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 44 00000100:00100000:1.0:1788940781.275131:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840036038656:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788940781.278832:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788940781.278840:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788940780 -> 1788940779 00002000:00010000:1.0:1788940781.278843:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788940779 00002000:00010000:1.0:1788940781.278845:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788940780 -> 1788940779 00002000:00010000:1.0:1788940781.278847:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788940781.278920:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2358:x1875840036038656:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 Request processed in 3785us (3970us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788940781.278930:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 44 00000100:00100000:1.0:1788940781.286863:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940781.287126:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036038912 00000100:00100000:3.0:1788940781.287137:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036038912 00000100:00100000:1.0:1788940781.287295:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 126 00000100:00100000:1.0:1788940781.287308:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:10563:x1875840036038912:12345-192.168.202.17@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788940781.287391:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.287408:0:7198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3508 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265a3 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.287415:0:7198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.287449:0:7198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265a3 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.287461:0:7198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265a3 expref: 15 pid: 5833 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940781.287476:0:7198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068559616:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940781.287577:0:7198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41034e80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940781.294062:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940781.294157:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036039040 00000100:00100000:0.0:1788940781.294166:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036039040 00010000:00010000:0.0:1788940781.294253:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3508 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265a3 expref: 16 pid: 5833 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940781.294290:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 57 00000100:00100000:0.0:1788940781.294300:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:2358:x1875840036039040:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940781.294330:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940781.294338:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3508 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265a3 expref: 16 pid: 5833 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.294350:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265a3 expref: 16 pid: 5833 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.294370:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:0.0:1788940781.294375:0:7622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.294384:0:7622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.294406:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.294424:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940781.294475:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:2358:x1875840036039040:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 177us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940781.294482:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 57 00010000:00010000:1.0:1788940781.294901:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3508 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265a3 expref: 15 pid: 5833 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940781.294919:0:7198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068559616:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940781.294947:0:7198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.294956:0:7198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.294970:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.294997:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.295004:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.295011:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.295016:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940781.295020:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.295027:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.295036:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:1.0:1788940781.295039:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788940781.295044:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.295050:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa354e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940781.295105:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:10563:x1875840036038912:12345-192.168.202.17@tcp:55:lhsmtool_posix.0 Request processed in 7801us (8251us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788940781.295114:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 126 00000100:00100000:2.0:1788940781.297568:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940781.297759:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036039168 00000100:00100000:0.0:1788940781.297768:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036039168 00000100:00100000:0.0:1788940781.297821:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 45 00000100:00100000:0.0:1788940781.297833:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036039168:12345-192.168.202.17@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788940781.297876:0:6671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081a2f9b1/0xa1d8aa9164aa3555 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.297897:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3532 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265bf expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.297906:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940781.297911:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940781.297916:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081a2f9b1/0xa1d8aa9164aa3555 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.297955:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265bf expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.297969:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265bf expref: 7 pid: 6674 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940781.298001:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1875840068559744:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940781.298084:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4105567b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940781.306790:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1875840068559744:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940781.306824:0:6671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000081a2f9b1/0xa1d8aa9164aa3555 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940781.328374:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940781.329344:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036039296 00000100:00100000:3.0:1788940781.329356:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036039296 00010000:00010000:3.0:1788940781.329397:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265bf expref: 8 pid: 6674 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940781.329483:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 58 00000100:00100000:3.0:1788940781.329493:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a058a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2359:x1875840036039296:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940781.329517:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940781.329538:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265bf expref: 8 pid: 6674 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.329551:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3532 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265bf expref: 8 pid: 6674 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.329575:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3532 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265bf expref: 8 pid: 6674 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.329592:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940781.329609:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940781.329615:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081a2f9b1/0xa1d8aa9164aa3555 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.329624:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081a2f9b1/0xa1d8aa9164aa3555 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.329659:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940781.329729:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a058a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036039296:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 237us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940781.329737:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 58 00010000:00010000:2.0:1788940781.329801:0:6671:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000081a2f9b1/0xa1d8aa9164aa3555 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.329811:0:6671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081a2f9b1/0xa1d8aa9164aa3555 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.329834:0:6671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081a2f9b1/0xa1d8aa9164aa3555 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.329843:0:6671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081a2f9b1/0xa1d8aa9164aa3555 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.329851:0:6671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081a2f9b1/0xa1d8aa9164aa3555 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.329870:0:6671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234000 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940781.329874:0:6671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081a2f9b1/0xa1d8aa9164aa3555 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.329882:0:6671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081a2f9b1/0xa1d8aa9164aa3555 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.329894:0:6671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081a2f9b1/0xa1d8aa9164aa3555 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.329901:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081a2f9b1/0xa1d8aa9164aa3555 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940781.329946:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840036039168:12345-192.168.202.17@tcp:1:lhsmtool_posix.0 Request processed in 32115us (32388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940781.329954:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 45 00000100:00100000:3.0:1788940781.346712:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940781.346902:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036039552 00000100:00100000:0.0:1788940781.346913:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036039552 00000100:00100000:0.0:1788940781.346972:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 127 00000100:00100000:0.0:1788940781.346983:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:10563:x1875840036039552:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788940781.347058:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa355c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.347075:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa355c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.347087:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa355c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.347662:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.347736:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3516 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265aa expref: 15 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.347745:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.347788:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3516 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265aa expref: 15 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.347803:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3516 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265aa expref: 15 pid: 7198 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940781.347817:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875840068559872:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940781.347891:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4105567b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940781.351176:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875840068559872:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940781.351304:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940781.353086:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940781.353619:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036039680 00000100:00100000:0.0:1788940781.353630:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036039680 00010000:00010000:0.0:1788940781.354423:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3516 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265aa expref: 16 pid: 7198 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940781.355842:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 59 00000100:00100000:1.0:1788940781.355865:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002582300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:2358:x1875840036039680:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940781.355882:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940781.355893:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3516 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265aa expref: 16 pid: 7198 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.355908:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3516 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265aa expref: 16 pid: 7198 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.355930:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3516 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265aa expref: 16 pid: 7198 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.355947:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:1.0:1788940781.355953:0:7622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.355962:0:7622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.355971:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940781.356004:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940781.356069:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002582300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:2358:x1875840036039680:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 214us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940781.356076:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 59 00010000:00010000:0.0:1788940781.356466:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.356475:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940781.356693:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788940781.356829:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788940781.356872:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788940781.356950:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41129dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5834:1875840068560000:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788940781.357031:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940781.357079:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411368acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940781.357942:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068560000 00000100:00100000:3.0:1788940781.357953:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068560000 00000100:00100000:3.0:1788940781.358005:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940781.358014:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5834:x1875840068560000:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788940781.358107:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5834:x1875840068560000:12345-0@lo:1000:mdt00_001.0 Request processed in 94us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940781.358115:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788940781.358151:0:5834:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788940781.358157:0:5834:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1788940781.358175:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f41115af800, transno 4294967309 00000100:00100000:3.0:1788940781.358226:0:5834:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8f41115af480 x1875840068559232/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788940797 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940781.358238:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41129dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5834:1875840068560000:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788940781.358720:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788940781.358791:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002583800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5834:1875840068560128:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788940781.358826:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940781.358848:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1eaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940781.359024:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068560128 00000100:00100000:3.0:1788940781.359029:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068560128 00000100:00100000:3.0:1788940781.359053:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940781.359061:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5834:x1875840068560128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788940781.359246:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5834:x1875840068560128:12345-0@lo:1000:mdt00_001.0 Request processed in 185us (419us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788940781.359252:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940781.359283:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002583800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5834:1875840068560128:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788940781.359322:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359331:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359339:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359345:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940781.359349:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359357:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359371:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:3.0:1788940781.359374:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940781.359384:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359391:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3563 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359419:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa34a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359425:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa34a6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359430:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa34a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359435:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940781.359438:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa34a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359444:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa34a6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359451:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:3.0:1788940781.359454:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940781.359460:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa34ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22658e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359471:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa34ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22658e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359481:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa34ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22658e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.359513:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa34ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22658e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940781.359524:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002582680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875840068560256:192.168.202.17@tcp:105: 00000100:00100000:3.0:1788940781.359588:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1eaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940781.377999:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940781.378534:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036039808 00000100:00100000:0.0:1788940781.378545:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036039808 00000100:00100000:0.0:1788940781.378611:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 31 00000100:00100000:0.0:1788940781.378621:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:10562:x1875840036039808:12345-192.168.202.17@tcp:49:lfs.0 00000100:00100000:0.0:1788940781.378764:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:10562:x1875840036039808:12345-192.168.202.17@tcp:49:lfs.0 Request processed in 144us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940781.378772:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 31 00000100:00100000:3.0:1788940781.382952:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002582680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875840068560256:192.168.202.17@tcp:105: 00010000:00010000:3.0:1788940781.382986:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa34a6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.382997:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa34a6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386043:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa356a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386069:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa356a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386081:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa356a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386095:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa356a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386116:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa356a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386122:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa356a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386128:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940781.386131:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa356a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386138:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa356a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386149:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:2.0:1788940781.386152:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940781.386157:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa356a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386163:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa356a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386175:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa355c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386182:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa355c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386239:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa355c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386244:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940781.386253:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa355c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386259:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa355c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386269:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:2.0:1788940781.386272:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788940781.386274:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa355c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.386281:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa355c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940781.386798:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940781.386804:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940781.387349:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788940781.387359:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788940781.391521:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:10563:x1875840036039552:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 44518us (44799us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788940781.391535:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 127 00000020:00080000:2.0:1788940781.391544:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788940781.391756:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940781.394699:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036040064 00000100:00100000:3.0:1788940781.394715:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036040064 00000100:00100000:3.0:1788940781.394779:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 128 00000100:00100000:3.0:1788940781.394792:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:10562:x1875840036040064:12345-192.168.202.17@tcp:58:lfs.0 00000040:00080000:3.0:1788940781.395152:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788940781.398779:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:10562:x1875840036040064:12345-192.168.202.17@tcp:58:lfs.0 Request processed in 3977us (7011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940781.398794:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 128 00000100:00100000:2.0:1788940781.406716:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940781.406883:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036040320 00000100:00100000:0.0:1788940781.406893:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036040320 00000100:00100000:0.0:1788940781.406951:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 32 00000100:00100000:0.0:1788940781.406962:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41057c6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:10563:x1875840036040320:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788940781.407895:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788940781.408006:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788940781.408054:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3571 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.408071:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.408084:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.408092:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3571 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.408099:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3571 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.408116:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940781.408139:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940781.409722:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940781.409735:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3571 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.409759:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940781.409763:0:7621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3571 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.409773:0:7621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.409788:0:7621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:3.0:1788940781.409791:0:7621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788940781.409796:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3571 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.409802:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3571 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.409821:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940781.409822:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940781.409824:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940781.411305:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41057c6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:10563:x1875840036040320:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 Request processed in 4335us (4589us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788940781.411329:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 32 00000020:00080000:0.0:1788940781.411338:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788940781.466558:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940781.466956:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036040448 00000100:00100000:2.0:1788940781.466968:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036040448 00000100:00100000:2.0:1788940781.467038:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 129 00000100:00100000:2.0:1788940781.467049:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:10565:x1875840036040448:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940781.467075:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940781.467098:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3578 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2265c6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.467165:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa357f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.467236:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa357f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.467248:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa357f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.467264:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3586 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.467272:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.467278:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.468768:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa358d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.468787:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226587 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.468796:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa358d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.468832:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226587 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.468860:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226587 expref: 21 pid: 5834 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940781.468889:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a059f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068560384:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940781.469047:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a62b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940781.477351:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a059f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068560384:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940781.477381:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa358d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940781.478995:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940781.479087:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036040704 00000100:00100000:2.0:1788940781.479096:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036040704 00000100:00100000:2.0:1788940781.479153:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 33 00000100:00100000:2.0:1788940781.479163:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:5602:x1875840036040704:12345-192.168.202.17@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788940781.479434:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:5602:x1875840036040704:12345-192.168.202.17@tcp:35:ldlm_bl.0 Request processed in 272us (445us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788940781.479443:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 33 00000100:00100000:0.0:1788940781.493526:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940781.493582:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036040832 00000100:00100000:3.0:1788940781.493602:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036040832 00010000:00010000:3.0:1788940781.493645:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226587 expref: 23 pid: 5834 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940781.493699:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 60 00000100:00100000:3.0:1788940781.493710:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41080e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:2358:x1875840036040832:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940781.493724:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940781.493731:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226587 expref: 23 pid: 5834 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.493762:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226587 expref: 23 pid: 5834 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.493784:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3498 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226587 expref: 23 pid: 5834 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.493801:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:3.0:1788940781.493806:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa358d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.493815:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa358d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.493824:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa358d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940781.493859:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940781.493929:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41080e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:2358:x1875840036040832:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 220us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940781.493937:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 60 00010000:00010000:2.0:1788940781.498066:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa358d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498083:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa358d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940781.498136:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788940781.498141:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940781.498165:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa358d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498182:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa358d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498253:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa357f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498260:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa357f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498267:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa357f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498273:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940781.498278:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa357f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498286:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa357f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498303:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:2.0:1788940781.498305:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940781.498322:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa357f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498329:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa357f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498343:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498349:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3586 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498355:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3586 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498367:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940781.498370:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3586 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498376:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3586 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498384:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8f41054d7f00) 00010000:00010000:2.0:1788940781.498386:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940781.498389:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3586 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498395:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3586 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498438:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa3578 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265c6 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498453:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa358d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265c6 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940781.498460:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:2.0:1788940781.498462:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940781.498465:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050a00, rc 0) 00000100:00100000:2.0:1788940781.498542:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:10565:x1875840036040448:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 31493us (31993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940781.498551:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 129 00010000:00010000:0.0:1788940782.157213:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788940782.180809:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1788940782.180824:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1788940782.180833:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000040:00080000:2.0:1788940782.410104:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788940782.410129:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940782.410179:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788940782.410279:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788940782.411124:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a059f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875840068560512:192.168.202.17@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788940782.430037:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940782.430158:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036040960 00000100:00100000:1.0:1788940782.430172:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036040960 00000100:00100000:1.0:1788940782.430238:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 130 00000100:00100000:1.0:1788940782.430247:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:10577:x1875840036040960:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788940782.430278:0:7198:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788940782.430489:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:10577:x1875840036040960:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 Request processed in 242us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940782.430497:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 130 00000100:00100000:2.0:1788940782.433821:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a62b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788940782.433867:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a059f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875840068560512:192.168.202.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788940782.445856:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940782.445926:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036041216 00000100:00100000:3.0:1788940782.445936:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036041216 00000100:00100000:3.0:1788940782.445998:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 131 00000100:00100000:3.0:1788940782.446009:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:10577:x1875840036041216:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940782.446030:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940782.446052:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3594 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2265cd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.446163:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa359b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.446177:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa359b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.446214:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa359b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940782.446225:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788940782.446413:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3594 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265cd expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.446431:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa359b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265cd expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.446440:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:3.0:1788940782.446443:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940782.446446:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36000, rc 0) 00000100:00100000:3.0:1788940782.446501:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:10577:x1875840036041216:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 494us (653us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788940782.446509:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 131 00000100:00100000:2.0:1788940782.456377:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940782.456461:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036041472 00000100:00100000:3.0:1788940782.456472:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036041472 00000100:00100000:3.0:1788940782.456538:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 132 00000100:00100000:3.0:1788940782.456548:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:10577:x1875840036041472:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788940782.456639:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa35a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.456665:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa35a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.456678:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa35a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.456884:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa35a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.456892:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa35a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.456899:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa35a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.456906:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940782.456910:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa35a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.456918:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa35a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.456930:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:3.0:1788940782.456934:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788940782.456939:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa35a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.456945:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa35a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940782.457071:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:10577:x1875840036041472:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 524us (706us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788940782.457086:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 132 00000040:00080000:3.0:1788940782.457233:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940782.457237:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940782.457876:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788940782.457886:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788940782.461799:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940782.462452:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036041600 00000100:00100000:3.0:1788940782.462463:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036041600 00000100:00100000:3.0:1788940782.462531:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00100000:3.0:1788940782.462542:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:2358:x1875840036041600:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940782.462558:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788940782.462566:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00010000:00010000:3.0:1788940782.462582:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa359b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265cd expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940782.462599:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:3.0:1788940782.462604:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940782.462649:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:2358:x1875840036041600:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 108us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940782.463091:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036041856 00000100:00100000:2.0:1788940782.463098:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036041856 00000100:00100000:2.0:1788940782.463133:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 34 00000100:00100000:2.0:1788940782.463142:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:10577:x1875840036041856:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788940782.463763:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00100000:2.0:1788940782.464012:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:10577:x1875840036041856:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 Request processed in 870us (1444us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788940782.464620:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 34 00000040:00080000:0.0:1788940782.544974:0:12100:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940782.544983:0:12100:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940782.545031:0:12100:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788940782.545037:0:12100:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788940782.602393:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068560896:0@lo:400:kworker.0 00000100:00100000:2.0:1788940782.602491:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940782.602550:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940782.602557:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068561024:0@lo:400:kworker.0 00000100:00100000:2.0:1788940782.602583:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940782.602836:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a058380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068560640:0@lo:400:kworker.0 00000100:00100000:0.0:1788940782.602882:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940782.602913:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068561152:0@lo:400:kworker.0 00000100:00100000:0.0:1788940782.602934:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940782.602950:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788940782.602955:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a058000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068560768:0@lo:400:kworker.0 00000100:00100000:0.0:1788940782.602973:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940782.602990:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068561280:0@lo:400:kworker.0 00000100:00100000:0.0:1788940782.603024:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940782.603052:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068560896 00000100:00100000:0.0:1788940782.603060:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068560896 00000100:00100000:0.0:1788940782.603105:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068561152 00000100:00100000:0.0:1788940782.603108:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068561152 00000100:00100000:0.0:1788940782.603119:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068560768 00000100:00100000:0.0:1788940782.603121:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068560768 00000100:00100000:0.0:1788940782.603143:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788940782.603151:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068560896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940782.603222:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068560896:12345-0@lo:400:kworker.0 Request processed in 72us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940782.603229:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788940782.603243:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788940782.603249:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068561152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940782.603276:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068561152:12345-0@lo:400:kworker.0 Request processed in 28us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940782.603281:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788940782.603291:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788940782.603296:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068560768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940782.603336:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068560768:12345-0@lo:400:kworker.0 Request processed in 40us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940782.603342:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788940782.603374:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a058000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068560768:0@lo:400:kworker.0 00000100:00100000:0.0:1788940782.603383:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068561152:0@lo:400:kworker.0 00000100:00100000:0.0:1788940782.603409:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068560896:0@lo:400:kworker.0 00000100:00100000:2.0:1788940782.605884:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068560640 00000100:00100000:2.0:1788940782.605899:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068560640 00000100:00100000:2.0:1788940782.605970:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788940782.605981:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068560640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940782.606064:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068560640:12345-0@lo:400:kworker.0 Request processed in 85us (3181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940782.606085:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788940782.606320:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068561024 00000100:00100000:3.0:1788940782.606326:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068561024 00000100:00100000:3.0:1788940782.606356:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068561280 00000100:00100000:3.0:1788940782.606359:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068561280 00000100:00100000:3.0:1788940782.606383:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788940782.606390:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1875840068561024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940782.606430:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1875840068561024:12345-0@lo:400:kworker.0 Request processed in 41us (3846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940782.606447:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788940782.606460:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788940782.606466:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068561280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940782.606494:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068561280:12345-0@lo:400:kworker.0 Request processed in 29us (3469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940782.606500:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788940782.608529:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068561024:0@lo:400:kworker.0 00000100:00100000:0.0:1788940782.608576:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788940782.608593:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788940782.608610:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f413508df80, transno 4294967304 00000100:00100000:0.0:1788940782.608631:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068561280:0@lo:400:kworker.0 00000100:00100000:0.0:1788940782.608643:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a058380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068560640:0@lo:400:kworker.0 00000100:00080000:0.0:1788940782.612135:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940782.612147:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940782.863409:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940782.863447:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036042112 00000100:00100000:2.0:1788940782.863456:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036042112 00000100:00100000:2.0:1788940782.863506:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 133 00000100:00100000:2.0:1788940782.863517:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:10590:x1875840036042112:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940782.863542:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940782.863564:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa35b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2265d4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.867134:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa35b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.867163:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa35b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.867180:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa35b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940782.868907:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788940782.869064:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa35b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265d4 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.869082:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa35b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265d4 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.869092:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:2.0:1788940782.869095:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788940782.869104:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142051c00, rc 0) 00000100:00100000:2.0:1788940782.869205:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10590:x1875840036042112:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 5670us (5786us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788940782.869215:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 133 00000100:00100000:3.0:1788940782.872675:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940782.872743:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036042240 00000100:00100000:2.0:1788940782.872753:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036042240 00000100:00100000:2.0:1788940782.872819:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 134 00000100:00100000:2.0:1788940782.872830:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10590:x1875840036042240:12345-192.168.202.17@tcp:54:lfs.0 00010000:00010000:2.0:1788940782.872899:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa35c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.872917:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa35c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.872930:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa35c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.872957:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa35c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.872964:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa35c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.872972:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa35c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.872978:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940782.872983:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa35c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.872992:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa35c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.873015:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:2.0:1788940782.873018:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940782.873023:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa35c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940782.873030:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa35c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940782.873105:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:10590:x1875840036042240:12345-192.168.202.17@tcp:54:lfs.0 Request processed in 276us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940782.873112:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 134 00000100:00100000:3.0:1788940782.920600:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940782.920791:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036042368 00000100:00100000:0.0:1788940782.920803:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036042368 00000100:00100000:0.0:1788940782.920904:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 46 00000100:00100000:0.0:1788940782.920915:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840036042368:12345-192.168.202.17@tcp:101:cat.0 00010000:00010000:0.0:1788940782.920933:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940782.920951:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa35cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2265db expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940782.920976:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa111eb, atime: 0x6aa111eb, ctime: 0x6aa111eb, blocks: 0xb 00010000:00010000:0.0:1788940782.920993:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788940782.920997:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940782.921003:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa35cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265db expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940782.921017:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa35cc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265db expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940782.921043:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234200, rc 0) 00000100:00100000:0.0:1788940782.921093:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2358:x1875840036042368:12345-192.168.202.17@tcp:101:cat.0 Request processed in 181us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940782.921099:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 46 00000100:00100000:2.0:1788940782.923800:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940782.923897:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036042496 00000100:00100000:1.0:1788940782.923909:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036042496 00002000:00100000:1.0:1788940782.923954:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8f413a047b80 x1875840036042496/t0(0) o3->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:3/0 lens 488/0 e 0 to 0 dl 1788940793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940782.923965:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f413a047b80 with x1875840036042496 ext(0->4095) 00002000:00010000:1.0:1788940782.923971:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f413a047b80 00000100:00100000:1.0:1788940782.923997:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 3 00000100:00100000:1.0:1788940782.924006:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2360:x1875840036042496:12345-192.168.202.17@tcp:3:cat.0 00000100:00100000:1.0:1788940782.924238:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a047b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2360:x1875840036042496:12345-192.168.202.17@tcp:3:cat.0 Request processed in 232us (446us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788940782.924248:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 3 00002000:00100000:1.0:1788940782.924255:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8f413a047b80 x1875840036042496/t0(0) o3->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:3/0 lens 488/4536 e 0 to 0 dl 1788940793 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940782.924263:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f413a047b80 with x1875840036042496 ext(0->4095) 00002000:00010000:1.0:1788940782.924266:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f413a047b80 00000100:00100000:3.0:1788940783.113821:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940783.113846:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068561408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940783.113920:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940783.114074:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068561408 00000100:00100000:1.0:1788940783.114109:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068561408 00000100:00100000:1.0:1788940783.114163:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788940783.114172:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068561408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940783.114244:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940783.114332:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068561408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940783.114340:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788940783.114815:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068561408:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940783.179304:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940784.201354:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940784.648482:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068561536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940784.648560:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940784.648849:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068561536 00000100:00100000:1.0:1788940784.648859:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068561536 00000100:00100000:1.0:1788940784.649035:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788940784.649046:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875840068561536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940784.649112:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940784.649160:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a045f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875840068561536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940784.649168:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788940784.649249:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940784.649250:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068561536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940784.820238:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940784.820292:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940784.820329:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940784.820359:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940784.820392:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036043008 00000100:00100000:0.0:1788940784.820401:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036043008 00000100:00100000:0.0:1788940784.820477:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036042880 00000100:00100000:0.0:1788940784.820481:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036042880 00000100:00100000:0.0:1788940784.820508:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 87 00000100:00100000:0.0:1788940784.820521:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2360:x1875840036043008:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940784.820757:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036042752 00000100:00100000:3.0:1788940784.820761:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036042752 00000100:00100000:3.0:1788940784.820791:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 159 00000100:00100000:3.0:1788940784.820798:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:2360:x1875840036042752:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940784.820829:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:2360:x1875840036042752:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 31us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940784.820836:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 159 00000100:00100000:3.0:1788940784.820874:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 88 00000100:00100000:3.0:1788940784.820882:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a05ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2360:x1875840036042880:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940784.820905:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a05ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2360:x1875840036042880:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 25us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940784.820929:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 88 00000100:00080000:3.0:1788940784.820948:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940784.820952:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940784.820954:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940784.821041:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2360:x1875840036043008:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 75us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940784.821049:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 87 00000100:00100000:1.0:1788940784.821882:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036042624 00000100:00100000:1.0:1788940784.821890:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036042624 00000100:00100000:1.0:1788940784.821931:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 299 00000100:00100000:1.0:1788940784.821938:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840036042624:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940784.821982:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840036042624:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 44us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940784.821989:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 299 00000100:00100000:0.0:1788940784.822990:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940784.823107:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036043136 00000100:00100000:2.0:1788940784.823114:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036043136 00000100:00080000:3.0:1788940784.823240:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940784.823625:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 160 00000100:00100000:2.0:1788940784.823646:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840036043136:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940784.823710:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840036043136:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 76us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940784.823717:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 160 00010000:00010000:3.0:1788940785.224946:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788940786.238282:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000001:00080000:1.0:1788940786.238332:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1788940786.238370:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f413f1ea840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788940786.238376:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f413a5b9b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f413f1eac00 00000020:00080000:1.0:1788940786.238393:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f413a5b9700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f41168b2c00 00000020:00080000:1.0:1788940786.238404:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788940786.238539:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788940786.238734:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1788940786.249899:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788940786.828348:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1788940786.828702:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1788940786.828712:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:3.0:1788940787.272445:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940787.720685:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940787.720749:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940787.720770:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068561792:0@lo:400:kworker.0 00000100:00100000:2.0:1788940787.720838:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940787.721360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068561792 00000100:00100000:3.0:1788940787.721369:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068561792 00000100:00100000:3.0:1788940787.721417:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788940787.721426:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068561792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940787.721482:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068561792:12345-0@lo:400:kworker.0 Request processed in 56us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940787.721489:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788940787.721548:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068561792:0@lo:400:kworker.0 00000100:00100000:1.0:1788940787.723423:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068561664:0@lo:400:kworker.0 00000100:00100000:1.0:1788940787.723569:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940787.725549:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068561920:0@lo:400:kworker.0 00000100:00100000:0.0:1788940787.725607:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940787.725749:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940787.725757:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068562048:0@lo:400:kworker.0 00000100:00100000:0.0:1788940787.725795:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940787.725897:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068562048 00000100:00100000:3.0:1788940787.725906:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068562048 00000100:00100000:3.0:1788940787.725972:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788940787.725983:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068562048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940787.726035:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068562048:12345-0@lo:400:kworker.0 Request processed in 55us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940787.726053:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788940787.726090:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f2d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068562176:0@lo:400:kworker.0 00000100:00100000:3.0:1788940787.726117:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940787.726138:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940787.726143:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068562304:0@lo:400:kworker.0 00000100:00100000:3.0:1788940787.726164:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940787.726215:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068561920 00000100:00100000:3.0:1788940787.726220:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068561920 00000100:00100000:3.0:1788940787.726245:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068562176 00000100:00100000:3.0:1788940787.726248:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068562176 00000100:00100000:3.0:1788940787.726282:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788940787.726290:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068561920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940787.726333:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068561920:12345-0@lo:400:kworker.0 Request processed in 44us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940787.726339:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788940787.726354:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788940787.726361:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068562176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940787.726390:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068562176:12345-0@lo:400:kworker.0 Request processed in 31us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940787.726395:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788940787.726410:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068562304 00000100:00100000:3.0:1788940787.726413:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068562304 00000100:00100000:3.0:1788940787.726437:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788940787.726443:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068562304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940787.726472:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068562304:12345-0@lo:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940787.726478:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788940787.726532:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788940787.726545:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f41115af480, transno 4294967310 00000004:00080000:3.0:1788940787.726555:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788940787.726576:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068562048:0@lo:400:kworker.0 00000100:00100000:3.0:1788940787.726591:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068561920:0@lo:400:kworker.0 00000100:00080000:0.0:1788940787.727390:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940787.727397:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940787.727399:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940787.729815:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068562304:0@lo:400:kworker.0 00000100:00100000:3.0:1788940787.729832:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413f2d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068562176:0@lo:400:kworker.0 00000100:00100000:2.0:1788940787.732206:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068561664 00000100:00100000:2.0:1788940787.732238:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068561664 00000100:00100000:3.0:1788940787.732785:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788940787.732798:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068561664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940787.732912:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068561664:12345-0@lo:400:kworker.0 Request processed in 116us (9342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940787.732920:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788940787.733131:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068561664:0@lo:400:kworker.0 00000100:00100000:3.0:1788940787.780561:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940787.780629:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036043264 00000100:00100000:2.0:1788940787.780653:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036043264 00000100:00100000:2.0:1788940787.780726:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 135 00000100:00100000:2.0:1788940787.780736:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:10242:x1875840036043264:12345-192.168.202.17@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788940787.780842:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:10242:x1875840036043264:12345-192.168.202.17@tcp:60:lhsmtool_posix.0 Request processed in 106us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940787.780849:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 135 00000100:00080000:0.0:1788940787.780921:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940787.796492:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940787.796655:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036043520 00000100:00100000:0.0:1788940787.796666:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036043520 00000100:00100000:0.0:1788940787.796729:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 35 00000100:00100000:0.0:1788940787.796741:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:10242:x1875840036043520:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788940787.797077:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:10242:x1875840036043520:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 Request processed in 338us (596us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788940787.797086:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 35 00000100:00100000:3.0:1788940788.233641:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068562432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940788.233722:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940788.233846:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068562432 00000100:00100000:1.0:1788940788.233855:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068562432 00000100:00100000:1.0:1788940788.233914:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788940788.233923:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068562432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940788.233958:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940788.234012:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068562432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940788.234020:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788940788.235321:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068562432:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788940788.296945:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940789.330336:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940789.771570:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940789.771603:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068562560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940789.771680:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940789.771743:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068562560 00000100:00100000:0.0:1788940789.771751:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068562560 00000100:00100000:0.0:1788940789.771808:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788940789.771818:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068562560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940789.771854:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940789.771901:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068562560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940789.771908:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788940789.771929:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940789.771961:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068562560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940789.937418:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940789.937470:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940789.937499:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940789.937501:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036043648 00000100:00100000:1.0:1788940789.937512:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036043648 00000100:00100000:3.0:1788940789.937533:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940789.937561:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940789.937567:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 301 00000100:00100000:1.0:1788940789.937577:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840036043648:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940789.937581:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036043904 00000100:00100000:3.0:1788940789.937596:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036043904 00000100:00100000:1.0:1788940789.937650:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840036043648:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 75us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940789.937658:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 301 00000100:00100000:3.0:1788940789.937660:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036044032 00000100:00100000:3.0:1788940789.937662:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036044032 00000100:00100000:3.0:1788940789.937682:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 91 00000100:00100000:1.0:1788940789.937687:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036044160 00000100:00100000:3.0:1788940789.937689:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2360:x1875840036043904:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940789.937689:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036044160 00000100:00100000:1.0:1788940789.937714:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036043776 00000100:00100000:1.0:1788940789.937717:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036043776 00000100:00100000:3.0:1788940789.937718:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2360:x1875840036043904:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 31us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940789.937725:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 91 00000100:00100000:3.0:1788940789.937735:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 92 00000100:00100000:1.0:1788940789.937735:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 164 00000100:00100000:3.0:1788940789.937741:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2360:x1875840036044032:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940789.937741:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840036044160:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940789.937764:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2360:x1875840036044032:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 23us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940789.937771:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 92 00000100:00100000:1.0:1788940789.937771:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2360:x1875840036044160:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940789.937777:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 164 00000100:00100000:1.0:1788940789.937787:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 165 00000100:00100000:1.0:1788940789.937794:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:2360:x1875840036043776:12345-192.168.202.17@tcp:400:kworker.0 00000100:00080000:0.0:1788940789.938018:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940789.938022:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:2360:x1875840036043776:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 162us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940789.938029:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 165 00000100:00080000:0.0:1788940789.938030:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940789.938032:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788940790.185665:0:12300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:59:47 (1788940787) 00010000:00010000:0.0:1788940790.346036:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788940790.664531:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940790.664542:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940790.664859:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788940790.664866:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788940791.356947:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788940791.356972:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788940791.357124:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788940791.357136:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788940791.368678:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940791.610743:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940791.610911:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036044416 00000100:00100000:0.0:1788940791.610922:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036044416 00000100:00100000:0.0:1788940791.611004:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 136 00000100:00100000:0.0:1788940791.611016:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:11299:x1875840036044416:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940791.611039:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1788940791.611040:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788940791.611077:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa35d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2265e2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611150:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa35da lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611165:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa35da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611177:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa35da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611244:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa35e1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611252:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa35e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611259:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa35e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611532:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa35e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611552:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa35e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611560:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa35e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940791.611571:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788940791.611707:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa35da lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611715:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa35da lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611723:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa35da lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611729:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940791.611734:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa35da lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611742:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa35da lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611754:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f410ad9f900) 00010000:00010000:0.0:1788940791.611757:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940791.611762:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa35da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.611768:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa35da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.612009:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa35e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.612024:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa35e1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.612030:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa35e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.612036:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940791.612039:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa35e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.612047:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa35e1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.612056:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f410ad9f500) 00010000:00010000:0.0:1788940791.612059:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940791.612062:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa35e1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.612068:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa35e1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.612968:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa35d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265e2 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.612988:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa35e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265e2 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.612996:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9fd00) 00010000:00010000:0.0:1788940791.612999:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940791.613007:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235a00, rc 0) 00000100:00100000:0.0:1788940791.613079:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:11299:x1875840036044416:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 2064us (2346us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788940791.613088:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 136 00000100:00100000:1.0:1788940791.633702:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940791.633754:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940791.633882:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036044544 00000100:00100000:0.0:1788940791.633893:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036044544 00000100:00100000:0.0:1788940791.633962:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:0.0:1788940791.633973:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:2358:x1875840036044544:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940791.633990:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940791.634016:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa35e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265e2 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940791.634035:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9fd00) 00010000:00010000:0.0:1788940791.634040:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940791.634101:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:2358:x1875840036044544:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 130us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940791.634109:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:3.0:1788940791.634619:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036044672 00000100:00100000:3.0:1788940791.634625:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036044672 00000100:00100000:3.0:1788940791.634663:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 137 00000100:00100000:3.0:1788940791.634671:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:11299:x1875840036044672:12345-192.168.202.17@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788940791.634750:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:11299:x1875840036044672:12345-192.168.202.17@tcp:59:lhsmtool_posix.0 Request processed in 80us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940791.634776:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 137 00000040:00080000:3.0:1788940791.690381:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940791.690391:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940791.690427:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788940791.690433:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788940792.392824:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940792.843142:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068562688:0@lo:400:kworker.0 00000100:00100000:0.0:1788940792.843246:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940792.843360:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068562688 00000100:00100000:2.0:1788940792.843368:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068562688 00000100:00100000:2.0:1788940792.843425:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788940792.843434:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068562688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940792.843733:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3301:x1875840068562688:12345-0@lo:400:kworker.0 Request processed in 299us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940792.843741:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788940792.843781:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068562816:0@lo:400:kworker.0 00000100:00100000:2.0:1788940792.843824:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940792.843858:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068562816 00000100:00100000:2.0:1788940792.843862:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068562816 00000100:00100000:2.0:1788940792.843888:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788940792.843894:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068562816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940792.843928:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068562816:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940792.843947:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788940792.843982:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068562816:0@lo:400:kworker.0 00000100:00100000:0.0:1788940792.844102:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41012ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3301:1875840068562688:0@lo:400:kworker.0 00000100:00100000:0.0:1788940792.844291:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068562944:0@lo:400:kworker.0 00000100:00100000:0.0:1788940792.844321:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940792.844577:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068562944 00000100:00100000:2.0:1788940792.844582:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068562944 00000100:00100000:2.0:1788940792.844620:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788940792.844628:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068562944:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788940792.844820:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940792.844833:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068563072:0@lo:400:kworker.0 00000100:00100000:3.0:1788940792.844866:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940792.844904:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068563072 00000100:00100000:3.0:1788940792.844908:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068563072 00000100:00100000:3.0:1788940792.844938:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788940792.844945:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068563072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940792.844980:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068563072:12345-0@lo:400:kworker.0 Request processed in 37us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940792.844986:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788940792.845004:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940792.845022:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068563072:0@lo:400:kworker.0 00000100:00100000:3.0:1788940792.845044:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4111298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068563328:0@lo:400:kworker.0 00000100:00100000:3.0:1788940792.845066:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940792.845083:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940792.845088:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068563200:0@lo:400:kworker.0 00000100:00100000:3.0:1788940792.845107:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940792.845129:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068563328 00000100:00100000:3.0:1788940792.845133:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068563328 00000100:00100000:3.0:1788940792.845161:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788940792.845167:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068563328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940792.845249:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068563328:12345-0@lo:400:kworker.0 Request processed in 82us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940792.845256:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788940792.845274:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940792.845289:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4111298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068563328:0@lo:400:kworker.0 00000100:00100000:3.0:1788940792.845310:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068563200 00000100:00100000:3.0:1788940792.845313:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068563200 00000100:00100000:3.0:1788940792.845340:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788940792.845346:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068563200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940792.845378:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068563200:12345-0@lo:400:kworker.0 Request processed in 32us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940792.845617:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068562944:12345-0@lo:400:kworker.0 Request processed in 989us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940792.845639:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1788940792.845656:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940792.845673:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068563200:0@lo:400:kworker.0 00000100:00100000:0.0:1788940792.845804:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068562944:0@lo:400:kworker.0 00000100:00100000:2.0:1788940792.846042:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788940793.355802:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940793.355828:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411141c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068563456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940793.355910:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940793.356068:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068563456 00000100:00100000:1.0:1788940793.356076:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068563456 00000100:00100000:1.0:1788940793.356130:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940793.356140:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068563456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940793.356175:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940793.356253:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068563456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940793.356260:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788940793.356402:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411141c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068563456:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940793.417013:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940793.743641:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940793.743887:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036044800 00000100:00100000:2.0:1788940793.743901:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036044800 00000100:00080000:3.0:1788940793.744000:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940793.744039:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 138 00000100:00100000:2.0:1788940793.744051:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:11342:x1875840036044800:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940793.744075:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940793.744135:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa35f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2265e9 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744240:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa35fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744258:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa35fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744271:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa35fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744288:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3604 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744304:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3604 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744310:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3604 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744763:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa35fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744774:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa35fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744781:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa35fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744788:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940793.744791:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa35fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744800:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa35fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744812:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f41129a4d00) 00010000:00010000:2.0:1788940793.744815:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940793.744821:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa35fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744827:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa35fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744839:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3604 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744851:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3604 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744857:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3604 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744862:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940793.744866:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3604 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744872:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3604 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744880:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f41054d7000) 00010000:00010000:2.0:1788940793.744882:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940793.744885:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3604 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744890:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3604 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744922:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa35f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265e9 expref: 15 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744933:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f41129a4d00) 00010000:00010000:2.0:1788940793.744936:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940793.744939:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa35f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265e9 expref: 15 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.744948:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050400, rc 0) 00000100:00100000:2.0:1788940793.745077:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:11342:x1875840036044800:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 1026us (1443us total) trans 0 rc 301/301 00000100:00100000:2.0:1788940793.745085:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 138 00000100:00100000:2.0:1788940793.750794:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940793.753166:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036045056 00000100:00100000:0.0:1788940793.753179:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036045056 00000100:00100000:1.0:1788940793.757026:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 139 00000100:00100000:1.0:1788940793.757038:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:11342:x1875840036045056:12345-192.168.202.17@tcp:36:lfs.0 00010000:00010000:1.0:1788940793.757100:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940793.757132:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa2f82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226429 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.757169:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f41129a4d00) 00010000:00010000:1.0:1788940793.757182:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940793.757433:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa360b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.757448:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa360b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.757459:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa360b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.757471:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3612 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.757478:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3612 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.757484:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3612 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940793.760768:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788940793.760791:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa360b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.760803:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa360b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.760811:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa360b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.760818:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940793.760830:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa360b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.760838:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa360b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.760855:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f41129a4500) 00010000:00010000:1.0:1788940793.760858:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940793.760863:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa360b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.760870:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa360b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940793.760891:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025556ae5 reply state 000000007edbc119 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3612 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940793.760900:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940793.761000:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:11342:x1875840036045056:12345-192.168.202.17@tcp:36:lfs.0 Request processed in 3960us (10214us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788940793.761010:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 139 00010000:00010000:0.0:1788940793.766591:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3612 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940793.766611:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3612 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940793.766619:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3612 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940793.766626:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940793.766630:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3612 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940793.766639:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3612 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940793.766658:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f41129a4000) 00010000:00010000:0.0:1788940793.766662:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940793.766667:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3612 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940793.766672:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3612 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940793.848894:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940793.849502:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036045184 00000100:00100000:1.0:1788940793.849513:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036045184 00000100:00100000:3.0:1788940793.850270:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 140 00000100:00100000:3.0:1788940793.850287:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:11350:x1875840036045184:12345-192.168.202.17@tcp:101:lctl.0 00010000:00010000:3.0:1788940793.850314:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940793.850349:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3619 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2265f0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.850442:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3620 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.850457:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.850472:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940793.850508:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788940793.850511:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940793.850547:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3620 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.850577:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3619 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265f0 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.850595:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3620 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265f0 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.850603:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:3.0:1788940793.850605:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940793.850610:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36800, rc 0) 00000100:00100000:3.0:1788940793.850683:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:11350:x1875840036045184:12345-192.168.202.17@tcp:101:lctl.0 Request processed in 401us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940793.850691:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 140 00000100:00100000:2.0:1788940793.912484:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940793.912559:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036045312 00000100:00100000:3.0:1788940793.912576:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036045312 00000100:00100000:3.0:1788940793.912655:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 141 00000100:00100000:3.0:1788940793.912666:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+15:11356:x1875840036045312:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:3.0:1788940793.912693:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940793.912715:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3627 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2265f7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.912809:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa362e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.912824:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa362e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.912840:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa362e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.912861:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3635 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.912868:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3635 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.912875:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3635 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913017:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa363c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913025:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa363c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913049:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa363c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940793.913092:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788940793.913096:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940793.913114:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa363c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913124:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa362e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913130:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa362e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913137:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa362e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913143:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940793.913147:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa362e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913154:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa362e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913165:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:3.0:1788940793.913168:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940793.913173:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa362e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913180:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa362e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913242:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3635 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913257:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3635 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913263:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3635 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913267:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940793.913270:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3635 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913276:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3635 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913283:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f4112cbf100) 00010000:00010000:3.0:1788940793.913286:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940793.913288:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3635 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913295:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3635 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913409:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3627 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265f7 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913426:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa363c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265f7 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.913433:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:3.0:1788940793.913435:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788940793.913442:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36e00, rc 0) 00000100:00100000:2.0:1788940793.915865:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:11356:x1875840036045312:12345-192.168.202.17@tcp:101:bash.0 Request processed in 3187us (3379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940793.915879:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 141 00000100:00100000:1.0:1788940793.920758:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940793.920983:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036045568 00000100:00100000:2.0:1788940793.920994:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036045568 00000100:00100000:2.0:1788940793.921254:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 142 00000100:00100000:2.0:1788940793.921267:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:11356:x1875840036045568:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:2.0:1788940793.921290:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940793.921312:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3643 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2265fe expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.921451:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa364a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.921466:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa364a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.921489:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa364a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.921542:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3651 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.921561:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.921590:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940793.922398:0:7198:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788940793.922579:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.922591:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.922601:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.922637:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa364a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.922645:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa364a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.922652:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa364a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.922658:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940793.922663:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa364a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.922672:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa364a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.922685:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:2.0:1788940793.922688:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940793.922702:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa364a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.922709:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa364a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940793.923369:0:7198:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e26f234 reply state 00000000ac927f25 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940793.923382:0:7198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788940793.923422:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3643 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265fe expref: 19 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.923439:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265fe expref: 18 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940793.923447:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7a00) 00010000:00010000:2.0:1788940793.923450:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940793.923453:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050600, rc 0) 00000100:00100000:2.0:1788940793.923716:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:11356:x1875840036045568:12345-192.168.202.17@tcp:101:bash.0 Request processed in 2450us (2968us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788940793.923794:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 142 00010000:00010000:1.0:1788940793.927683:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.927701:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3651 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.927708:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3651 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.927797:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940793.927867:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3651 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.927876:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3651 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.927893:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f41054d7000) 00010000:00010000:1.0:1788940793.927896:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940793.927901:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3651 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940793.927908:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3651 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940793.929612:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940793.932272:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036045696 00000100:00100000:3.0:1788940793.932288:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036045696 00000100:00100000:3.0:1788940793.933272:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 47 00000100:00100000:3.0:1788940793.933288:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2358:x1875840036045696:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:3.0:1788940793.933310:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940793.933330:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000209bb93b/0xa1d8aa9164aa3666 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226605 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940793.933355:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788940793.933374:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788940793.933378:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940793.933385:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000209bb93b/0xa1d8aa9164aa3666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226605 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.933401:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000209bb93b/0xa1d8aa9164aa3666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226605 expref: 6 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.933412:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41421c2800, rc 0) 00000100:00100000:3.0:1788940793.933473:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840036045696:12345-192.168.202.17@tcp:101:bash.0 Request processed in 191us (3871us total) trans 0 rc 0/0 00000100:00080000:0.0:1788940793.934138:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940793.935352:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 47 00000100:00100000:3.0:1788940793.936469:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940793.936588:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036045824 00000100:00100000:0.0:1788940793.936602:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036045824 00000100:00100000:0.0:1788940793.936656:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 48 00000100:00100000:0.0:1788940793.936665:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:11356:x1875840036045824:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:0.0:1788940793.936684:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940793.936708:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22660c expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940793.937141:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000209bb93b/0xa1d8aa9164aa3666 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226605 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940793.937150:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940793.937154:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940793.937160:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940793.937228:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000209bb93b/0xa1d8aa9164aa3666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226605 expref: 7 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940793.937243:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000209bb93b/0xa1d8aa9164aa3666 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226605 expref: 7 pid: 6671 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940793.937258:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8426:1875840068563584:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940793.937330:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a068cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940793.941719:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940793.941949:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036045952 00000100:00100000:3.0:1788940793.941957:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036045952 00000100:00100000:0.0:1788940793.941962:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8426:1875840068563584:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940793.941995:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.942007:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000209bb93b/0xa1d8aa9164aa3666 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226605 expref: 8 pid: 6671 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940793.942018:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235c00, rc 0) 00000100:00100000:3.0:1788940793.942069:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 61 00000100:00100000:3.0:1788940793.942081:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2359:x1875840036045952:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940793.942096:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940793.942120:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000209bb93b/0xa1d8aa9164aa3666 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226605 expref: 8 pid: 6671 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.942133:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000209bb93b/0xa1d8aa9164aa3666 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226605 expref: 8 pid: 6671 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.942158:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000209bb93b/0xa1d8aa9164aa3666 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226605 expref: 8 pid: 6671 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.942175:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940793.942180:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940793.942248:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940793.942259:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940793.942282:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:11356:x1875840036045824:12345-192.168.202.17@tcp:101:bash.0 Request processed in 5618us (5818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940793.942289:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 48 00010000:00010000:3.0:1788940793.942294:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940793.942307:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1875840068563712:192.168.202.17@tcp:105: 00000100:00100000:3.0:1788940793.942365:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4101370540 going to sleep for 11 seconds 00000100:00100000:3.0:1788940793.950960:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1875840068563712:192.168.202.17@tcp:105: 00010000:00010000:3.0:1788940793.950992:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940793.951053:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840036045952:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 8973us (9343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940793.951064:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 61 00000100:00100000:0.0:1788940793.958945:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940793.959109:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036046208 00000100:00100000:2.0:1788940793.959122:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036046208 00000100:00100000:2.0:1788940793.959236:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 36 00000100:00100000:2.0:1788940793.959246:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:11356:x1875840036046208:12345-192.168.202.17@tcp:35:bash.0 00000100:00100000:2.0:1788940793.959588:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:11356:x1875840036046208:12345-192.168.202.17@tcp:35:bash.0 Request processed in 342us (655us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788940793.959612:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 36 00000100:00100000:2.0:1788940794.094675:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940794.094837:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036046464 00000100:00100000:0.0:1788940794.095010:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036046464 00000100:00100000:0.0:1788940794.095108:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 143 00000100:00100000:0.0:1788940794.095119:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:11366:x1875840036046464:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940794.095144:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940794.095166:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3674 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226613 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940794.095286:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788940794.095401:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3674 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226613 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.095416:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:0.0:1788940794.095420:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940794.095425:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3674 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226613 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.095439:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234c00, rc 0) 00000100:00100000:0.0:1788940794.095504:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:11366:x1875840036046464:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 388us (840us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788940794.095512:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 143 00000100:00100000:1.0:1788940794.098953:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940794.099312:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036046720 00000100:00100000:2.0:1788940794.099325:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036046720 00000100:00100000:2.0:1788940794.099381:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 37 00000100:00100000:2.0:1788940794.099392:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:11366:x1875840036046720:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:2.0:1788940794.099703:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:11366:x1875840036046720:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 313us (758us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788940794.099711:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 37 00000100:00100000:3.0:1788940794.205380:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940794.214403:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036046848 00000100:00100000:0.0:1788940794.214424:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036046848 00000100:00100000:0.0:1788940794.214502:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 144 00000100:00100000:0.0:1788940794.214515:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:11372:x1875840036046848:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940794.214542:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940794.216754:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3682 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22661a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.216842:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.216858:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.216870:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940794.217075:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788940794.217080:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940794.217171:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.217302:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3682 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22661a expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.217326:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22661a expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.217334:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:0.0:1788940794.217336:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940794.217341:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235a00, rc 0) 00000100:00100000:0.0:1788940794.217516:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:11372:x1875840036046848:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 3002us (12145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940794.217525:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 144 00000100:00100000:0.0:1788940794.226154:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940794.226317:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036047104 00000100:00100000:2.0:1788940794.226327:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036047104 00000100:00100000:2.0:1788940794.226399:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 145 00000100:00100000:2.0:1788940794.226409:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:11372:x1875840036047104:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940794.226430:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940794.226452:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3690 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226621 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.226584:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3697 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.226600:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.226614:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940794.226625:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788940794.226770:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3690 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226621 expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.226790:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3697 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226621 expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.226798:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7a00) 00010000:00010000:2.0:1788940794.226801:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940794.226805:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142051400, rc 0) 00000100:00100000:2.0:1788940794.226874:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:11372:x1875840036047104:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 465us (729us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788940794.226881:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 145 00000100:00100000:1.0:1788940794.241009:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940794.241897:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036047360 00000100:00100000:2.0:1788940794.241913:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036047360 00000100:00100000:2.0:1788940794.241983:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 146 00000100:00100000:2.0:1788940794.241994:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:11372:x1875840036047360:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940794.242022:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940794.242056:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226628 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.242155:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.242169:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.242180:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940794.242255:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788940794.244354:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226628 expref: 27 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.244394:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226628 expref: 26 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.244404:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7a00) 00010000:00010000:2.0:1788940794.244406:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788940794.244410:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050e00, rc 0) 00000100:00100000:2.0:1788940794.244512:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:11372:x1875840036047360:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 2512us (3506us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788940794.244522:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 146 00000100:00100000:3.0:1788940794.246782:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940794.247007:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036047488 00000100:00100000:1.0:1788940794.247019:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036047488 00000100:00100000:1.0:1788940794.247097:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:1.0:1788940794.247107:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:2359:x1875840036047488:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940794.247123:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940794.247159:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3697 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226621 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.247178:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7a00) 00010000:00010000:1.0:1788940794.247183:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940794.247282:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+25:2359:x1875840036047488:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 176us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940794.247289:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:3.0:1788940794.254914:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940794.256465:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036047616 00000100:00100000:1.0:1788940794.256797:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036047616 00000100:00100000:1.0:1788940794.256974:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 49 00000100:00100000:1.0:1788940794.256988:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840036047616:12345-192.168.202.17@tcp:1:lfs.0 00010000:00010000:1.0:1788940794.257056:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f54dd5b4/0xa1d8aa9164aa36ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.257085:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.257096:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940794.257101:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940794.257106:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f54dd5b4/0xa1d8aa9164aa36ba lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.257167:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.257184:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 6 pid: 8426 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940794.257276:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6673:1875840068563840:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940794.257427:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003b15d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940794.264467:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940794.264768:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6673:1875840068563840:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940794.264825:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f54dd5b4/0xa1d8aa9164aa36ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940794.267305:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036047744 00000100:00100000:3.0:1788940794.267330:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036047744 00002000:00100000:3.0:1788940794.267668:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8f41420e6d80 x1875840036047744/t0(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:15/0 lens 504/0 e 0 to 0 dl 1788940805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940794.267682:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f41420e6d80 with x1875840036047744 ext(0->12) 00010000:00010000:3.0:1788940794.267695:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 7 pid: 8426 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940794.267719:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 7 pid: 8426 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940794.267728:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f41420e6d80 00000100:00100000:3.0:1788940794.267777:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 2 00000100:00100000:3.0:1788940794.267789:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2358:x1875840036047744:12345-192.168.202.17@tcp:4:lfs.0 00000100:00100000:3.0:1788940794.272949:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2358:x1875840036047744:12345-192.168.202.17@tcp:4:lfs.0 Request processed in 5151us (8488us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788940794.272974:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 2 00002000:00100000:3.0:1788940794.272987:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8f41420e6d80 x1875840036047744/t4294967305(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:15/0 lens 504/448 e 0 to 0 dl 1788940805 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788940794.273020:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f41420e6d80 with x1875840036047744 ext(0->12) 00010000:00010000:3.0:1788940794.273034:0:6677:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 9 pid: 8426 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940794.273059:0:6677:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 9 pid: 8426 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940794.273068:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f41420e6d80 00000100:00100000:0.0:1788940794.284265:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940794.284402:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036047872 00000100:00100000:2.0:1788940794.284417:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036047872 00010000:00010000:2.0:1788940794.284482:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 9 pid: 8426 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940794.284538:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 62 00000100:00100000:2.0:1788940794.284564:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2361:x1875840036047872:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940794.284586:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788940794.284615:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788940794.284618:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788940793 00002000:00010000:2.0:1788940794.284621:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788940793 00002000:00010000:2.0:1788940794.284624:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788940793 00010000:00010000:2.0:1788940794.284631:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 9 pid: 8426 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.284667:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 9 pid: 8426 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.284697:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc8444c9/0xa1d8aa9164aa366d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22660c expref: 9 pid: 8426 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.284720:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940794.284725:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940794.284732:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f54dd5b4/0xa1d8aa9164aa36ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.284744:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f54dd5b4/0xa1d8aa9164aa36ba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.284789:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940794.284863:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2361:x1875840036047872:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 314us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940794.284872:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 62 00010000:00010000:0.0:1788940794.285242:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f54dd5b4/0xa1d8aa9164aa36ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.285255:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f54dd5b4/0xa1d8aa9164aa36ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.285289:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f54dd5b4/0xa1d8aa9164aa36ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.285299:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f54dd5b4/0xa1d8aa9164aa36ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.285308:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f54dd5b4/0xa1d8aa9164aa36ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.285316:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940794.285321:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f54dd5b4/0xa1d8aa9164aa36ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.285330:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f54dd5b4/0xa1d8aa9164aa36ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.285345:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f54dd5b4/0xa1d8aa9164aa36ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.285380:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f54dd5b4/0xa1d8aa9164aa36ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940794.285449:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2358:x1875840036047616:12345-192.168.202.17@tcp:1:lfs.0 Request processed in 28462us (30550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940794.285458:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 49 00000100:00100000:1.0:1788940794.295304:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940794.295410:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036048128 00000100:00100000:0.0:1788940794.295432:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036048128 00000100:00100000:0.0:1788940794.295547:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 38 00000100:00100000:0.0:1788940794.295560:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41057c7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+25:11372:x1875840036048128:12345-192.168.202.17@tcp:35:lfs.0 00000004:00010000:0.0:1788940794.295654:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226628 expref: 25 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940794.295995:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788940794.296042:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788940794.296832:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788940794.296932:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.296953:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3658 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265fe expref: 29 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.296964:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.297005:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265fe expref: 29 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.297024:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3658 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265fe expref: 29 pid: 7198 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940794.297041:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1875840068563968:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940794.297142:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003b15900 going to sleep for 11 seconds 00000100:00100000:0.0:1788940794.327827:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940794.328262:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1875840068563968:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940794.328303:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940794.333041:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036048256 00000100:00100000:2.0:1788940794.333064:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036048256 00010000:00010000:2.0:1788940794.333231:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3658 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265fe expref: 30 pid: 7198 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940794.333290:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 63 00000100:00100000:2.0:1788940794.333303:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+30:2359:x1875840036048256:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940794.333345:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940794.333353:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3658 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265fe expref: 30 pid: 7198 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.333368:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265fe expref: 30 pid: 7198 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.333397:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa3658 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265fe expref: 30 pid: 7198 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.333417:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7a00) 00010000:00010000:2.0:1788940794.333424:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.333434:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.333443:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.333480:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940794.333714:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.333723:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940794.333904:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788940794.334166:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788940794.334362:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134c56680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875840068564096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788940794.334440:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940794.334494:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a0689c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940794.334526:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068564096 00000100:00100000:0.0:1788940794.334532:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068564096 00000100:00100000:0.0:1788940794.334589:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940794.334598:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875840068564096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788940794.334679:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875840068564096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940794.334688:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788940794.334711:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940794.334749:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134c56680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875840068564096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788940794.335321:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788940794.335389:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134c56680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875840068564224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788940794.335429:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940794.335463:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068564224 00000100:00100000:0.0:1788940794.335469:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068564224 00000100:00100000:0.0:1788940794.335495:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788940794.335502:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875840068564224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788940794.335654:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875840068564224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 152us (223us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788940794.335662:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788940794.335681:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a068300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940794.335704:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134c56680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875840068564224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788940794.335745:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788940794.335782:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.335794:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.335811:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.335818:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940794.335822:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.335832:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.335851:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7a00) 00010000:00010000:0.0:1788940794.335854:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788940794.335860:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.335867:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4200/0xa1d8aa9164aa36c1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788940794.336073:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1788940794.336286:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+33:2359:x1875840036048256:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 2981us (8482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940794.336298:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 63 00000040:00080000:0.0:1788940794.341470:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788940794.341509:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 435645320305ns, next at 436645313873ns, rc = 0 00000001:00080000:0.0:1788940794.341536:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788940794.341652:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7a00) 00010000:00010000:0.0:1788940794.341657:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788940794.341672:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226628 expref: 33 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940794.341947:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41057c7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:11372:x1875840036048128:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 46387us (46654us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788940794.341979:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 38 00000020:00080000:0.0:1788940794.341987:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788940794.348583:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940794.348704:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036048384 00000100:00100000:2.0:1788940794.348718:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036048384 00000100:00100000:2.0:1788940794.348805:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 147 00000100:00100000:2.0:1788940794.348821:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:11372:x1875840036048384:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940794.348874:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940794.348913:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa36c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22662f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.348995:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa36c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22662f expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.349015:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa36c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22662f expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.349038:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:2.0:1788940794.349042:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940794.349046:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050600, rc 0) 00000100:00100000:2.0:1788940794.349129:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+33:11372:x1875840036048384:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 312us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940794.349137:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 147 00000100:00100000:3.0:1788940794.356587:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940794.356749:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036048640 00000100:00100000:2.0:1788940794.356763:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036048640 00000100:00100000:2.0:1788940794.356828:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 39 00000100:00100000:2.0:1788940794.356841:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+33:11372:x1875840036048640:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:2.0:1788940794.357230:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+34:11372:x1875840036048640:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 391us (657us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788940794.357239:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 39 00010000:00010000:0.0:1788940794.440528:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940794.499378:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940794.499661:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036048896 00000100:00100000:2.0:1788940794.499676:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036048896 00000100:00100000:2.0:1788940794.499758:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 148 00000100:00100000:2.0:1788940794.499771:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+34:11382:x1875840036048896:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940794.499816:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940794.499855:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226636 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940794.499987:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788940794.500150:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226636 expref: 36 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.500169:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:2.0:1788940794.500172:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940794.500178:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226636 expref: 36 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.500241:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050400, rc 0) 00000100:00100000:2.0:1788940794.500496:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:11382:x1875840036048896:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 726us (1134us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788940794.500505:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 148 00000100:00100000:3.0:1788940794.509662:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940794.513717:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036049024 00000100:00100000:2.0:1788940794.513743:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036049024 00000100:00100000:2.0:1788940794.513851:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 149 00000100:00100000:2.0:1788940794.513866:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:11382:x1875840036049024:12345-192.168.202.17@tcp:34:lfs.0 00010000:00010000:2.0:1788940794.513973:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.513996:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514012:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514052:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514061:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514068:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514220:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa36eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514229:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa36eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514237:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa36eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940794.514292:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa36eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514308:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514315:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514323:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514330:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940794.514335:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514350:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514362:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:2.0:1788940794.514366:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940794.514371:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514377:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa36dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514393:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514398:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514404:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514409:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940794.514413:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514420:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514427:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f41054d7200) 00010000:00010000:2.0:1788940794.514430:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940794.514434:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514451:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa36e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514467:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa36eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514895:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa36eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514903:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa36eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514908:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940794.514911:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa36eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514918:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa36eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514928:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:2.0:1788940794.514930:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940794.514934:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa36eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940794.514940:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa36eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940794.515134:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:11382:x1875840036049024:12345-192.168.202.17@tcp:34:lfs.0 Request processed in 1268us (5484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940794.515143:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 149 00000100:00100000:3.0:1788940794.525737:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940794.525877:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036049280 00000100:00100000:2.0:1788940794.525891:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036049280 00000100:00100000:2.0:1788940794.525966:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 40 00000100:00100000:2.0:1788940794.525980:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:11382:x1875840036049280:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:2.0:1788940794.526357:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+36:11382:x1875840036049280:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 379us (634us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788940794.526366:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 40 00000100:00100000:3.0:1788940794.597415:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940794.597660:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036049536 00000100:00100000:0.0:1788940794.597675:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036049536 00000100:00100000:0.0:1788940794.597762:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 150 00000100:00100000:0.0:1788940794.597776:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+36:11385:x1875840036049536:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940794.597815:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940794.597854:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa36f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22663d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.597966:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa36f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.597985:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa36f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598000:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa36f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598019:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3700 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598026:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598033:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598302:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598313:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598320:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940794.598333:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788940794.598463:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa36f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598482:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa36f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598490:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa36f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598496:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940794.598502:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa36f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598510:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa36f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598525:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:0.0:1788940794.598528:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940794.598534:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa36f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598784:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa36f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598802:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598807:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3700 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598813:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598818:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940794.598822:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598828:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3700 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598836:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f410ad9f500) 00010000:00010000:0.0:1788940794.598838:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940794.598841:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3700 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598847:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3700 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598907:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa36f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22663d expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598924:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22663d expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940794.598938:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:0.0:1788940794.598941:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940794.598944:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234c00, rc 0) 00000100:00100000:0.0:1788940794.599097:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+38:11385:x1875840036049536:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 1323us (1698us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788940794.599107:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 150 00000100:00100000:3.0:1788940794.606160:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940794.606289:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036049664 00000100:00100000:1.0:1788940794.606305:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036049664 00000100:00100000:1.0:1788940794.606414:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 151 00000100:00100000:1.0:1788940794.606426:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+38:11385:x1875840036049664:12345-192.168.202.17@tcp:54:lfs.0 00010000:00010000:1.0:1788940794.606524:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3715 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.606559:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.606574:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.606609:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.606617:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3715 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.606625:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.606631:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940794.606636:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.606646:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3715 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.606660:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:1.0:1788940794.606663:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940794.606670:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3715 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940794.606688:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3715 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940794.608717:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+38:11385:x1875840036049664:12345-192.168.202.17@tcp:54:lfs.0 Request processed in 2277us (2556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940794.608735:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 151 00000100:00100000:3.0:1788940794.614579:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940794.614744:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036049920 00000100:00100000:0.0:1788940794.614759:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036049920 00000100:00100000:0.0:1788940794.614839:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 41 00000100:00100000:0.0:1788940794.614853:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+38:11385:x1875840036049920:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:0.0:1788940794.615172:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+39:11385:x1875840036049920:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 322us (609us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788940794.615181:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 41 00000100:00100000:3.0:1788940794.888523:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068564352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940794.888603:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940794.888798:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068564352 00000100:00100000:1.0:1788940794.888807:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068564352 00000100:00100000:1.0:1788940794.888874:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788940794.888884:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068564352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940794.888922:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940794.888970:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068564352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940794.888978:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788940794.889045:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940794.889169:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134c56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068564352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940795.021094:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940795.021241:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036050176 00000100:00100000:2.0:1788940795.021252:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036050176 00000100:00080000:0.0:1788940795.021774:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940795.021800:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 152 00000100:00100000:2.0:1788940795.021814:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+39:11416:x1875840036050176:12345-192.168.202.17@tcp:101:cat.0 00010000:00010000:2.0:1788940795.021838:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940795.021858:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa371c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226644 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.021956:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3723 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.021970:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.021983:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940795.021994:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788940795.022108:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa371c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226644 expref: 42 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.022125:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3723 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226644 expref: 41 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.022147:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:2.0:1788940795.022150:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940795.022153:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4142050400, rc 0) 00000100:00100000:2.0:1788940795.022267:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+41:11416:x1875840036050176:12345-192.168.202.17@tcp:101:cat.0 Request processed in 455us (1182us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788940795.022274:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 152 00000100:00100000:2.0:1788940795.026459:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940795.026508:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940795.026668:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036050560 00000100:00100000:0.0:1788940795.026680:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036050560 00000100:00100000:0.0:1788940795.026744:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 42 00000100:00100000:0.0:1788940795.026754:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+41:11416:x1875840036050560:12345-192.168.202.17@tcp:35:cat.0 00000100:00100000:0.0:1788940795.027038:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+42:11416:x1875840036050560:12345-192.168.202.17@tcp:35:cat.0 Request processed in 284us (528us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788940795.027047:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 42 00000100:00100000:1.0:1788940795.027550:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036050304 00000100:00100000:1.0:1788940795.027557:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036050304 00000100:00100000:1.0:1788940795.027604:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00100000:1.0:1788940795.027613:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41080e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+42:2361:x1875840036050304:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940795.027624:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940795.027646:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa3723 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226644 expref: 42 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.027663:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:1.0:1788940795.027668:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940795.027697:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41080e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+41:2361:x1875840036050304:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 86us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940795.027718:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00100000:2.0:1788940795.056391:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940795.056443:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940795.056482:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940795.056531:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940795.056569:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036051072 00000100:00100000:2.0:1788940795.056579:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036051072 00000100:00080000:2.0:1788940795.056611:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940795.056660:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 169 00000100:00100000:2.0:1788940795.056671:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840036051072:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940795.056759:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840036051072:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 90us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940795.056767:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 169 00000100:00100000:1.0:1788940795.057012:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036050944 00000100:00100000:1.0:1788940795.057017:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036050944 00000100:00100000:1.0:1788940795.057053:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036050816 00000100:00100000:1.0:1788940795.057056:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036050816 00000100:00100000:1.0:1788940795.057076:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 95 00000100:00100000:1.0:1788940795.057083:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036050944:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940795.057116:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036050944:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 34us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940795.057122:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 95 00000100:00100000:1.0:1788940795.057135:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 96 00000100:00100000:1.0:1788940795.057140:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840036050816:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940795.057161:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f538000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840036050816:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 21us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940795.057167:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 96 00000100:00100000:3.0:1788940795.057320:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036050688 00000100:00100000:3.0:1788940795.057325:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036050688 00000100:00100000:3.0:1788940795.057360:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 303 00000100:00100000:3.0:1788940795.057368:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2359:x1875840036050688:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940795.057412:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2359:x1875840036050688:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 45us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940795.057419:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 303 00000100:00080000:2.0:1788940795.057646:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940795.057650:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940795.097523:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940795.099025:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036051328 00000100:00100000:3.0:1788940795.099043:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036051328 00000100:00100000:3.0:1788940795.099264:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 153 00000100:00100000:3.0:1788940795.099278:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+41:11422:x1875840036051328:12345-192.168.202.17@tcp:101:dd.0 00010000:00010000:3.0:1788940795.099308:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940795.099312:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788940795.099356:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3689 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22661a expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.099483:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:3.0:1788940795.099491:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940795.099506:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3731 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22664b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.099603:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.099617:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3707 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22663d expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.099627:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.099658:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22663d expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.099693:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22663d expref: 41 pid: 5835 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940795.099707:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a5b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068564480:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940795.099807:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4101370d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940795.104876:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940795.104965:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036051456 00000100:00100000:1.0:1788940795.104975:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036051456 00010000:00010000:1.0:1788940795.105015:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3707 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22663d expref: 42 pid: 5835 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940795.105116:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 64 00000100:00100000:1.0:1788940795.105128:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+42:2359:x1875840036051456:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940795.105145:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940795.105153:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3707 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22663d expref: 42 pid: 5835 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.105212:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22663d expref: 42 pid: 5835 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.105236:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:1.0:1788940795.105242:0:7622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.105253:0:7622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.105261:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.105293:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940795.105366:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+42:2359:x1875840036051456:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 236us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940795.105374:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 64 00010000:00010000:0.0:1788940795.105736:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22663d expref: 41 pid: 5835 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940795.105768:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a5b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068564480:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940795.105797:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.105806:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.105812:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940795.105829:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788940795.105966:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa3731 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22664b expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.105981:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22664b expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.105988:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:0.0:1788940795.105991:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788940795.105993:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37e00, rc 0) 00000100:00100000:0.0:1788940795.106027:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+41:11422:x1875840036051328:12345-192.168.202.17@tcp:101:dd.0 Request processed in 6753us (8517us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788940795.106034:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 153 00000100:00100000:3.0:1788940795.113029:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940795.113496:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036051712 00000100:00100000:2.0:1788940795.113509:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036051712 00000100:00100000:2.0:1788940795.113606:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 154 00000100:00100000:2.0:1788940795.113625:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+41:11422:x1875840036051712:12345-192.168.202.17@tcp:36:dd.0 00010000:00010000:2.0:1788940795.113881:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3746 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.113899:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.113922:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940795.113974:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788940795.113998:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6522d3c reply state 00000000848925bd transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940795.114007:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940795.114108:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+44:11422:x1875840036051712:12345-192.168.202.17@tcp:36:dd.0 Request processed in 484us (1089us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788940795.114116:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 154 00000020:00080000:2.0:1788940795.114121:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788940795.122385:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.122412:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3746 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.122448:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3746 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.122456:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940795.122462:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3746 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.122483:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3746 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.122507:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:0.0:1788940795.122511:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940795.122517:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3746 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.122524:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa3746 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.465333:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940795.485619:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940795.485777:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036051840 00000100:00100000:2.0:1788940795.485788:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036051840 00000100:00100000:2.0:1788940795.485849:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 155 00000100:00100000:2.0:1788940795.485859:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+43:11436:x1875840036051840:12345-192.168.202.17@tcp:101:stat.0 00010000:00010000:2.0:1788940795.485884:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940795.485915:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa374d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226652 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.485976:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3754 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.486007:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.486019:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.486035:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa375b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.486043:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa375b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.486050:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa375b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.486134:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.486145:0:7198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22664b expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.486154:0:7198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3762 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.486241:0:7198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22664b expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.486256:0:7198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22664b expref: 44 pid: 5835 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940795.486282:0:7198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a695180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068564608:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940795.487492:0:7198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f179b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940795.492723:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940795.492817:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036052096 00000100:00100000:0.0:1788940795.492827:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036052096 00000100:00100000:0.0:1788940795.492881:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 43 00000100:00100000:0.0:1788940795.492892:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+45:5602:x1875840036052096:12345-192.168.202.17@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788940795.493304:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+46:5602:x1875840036052096:12345-192.168.202.17@tcp:35:ldlm_bl.0 Request processed in 413us (591us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788940795.493313:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 43 00000100:00100000:2.0:1788940795.493706:0:7198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a695180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068564608:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940795.493732:0:7198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940795.495586:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940795.495779:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036052224 00000100:00100000:1.0:1788940795.495789:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036052224 00010000:00010000:1.0:1788940795.495828:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22664b expref: 46 pid: 5835 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940795.495869:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 65 00000100:00100000:1.0:1788940795.495878:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+46:2358:x1875840036052224:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940795.495893:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940795.495909:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22664b expref: 46 pid: 5835 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.495941:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22664b expref: 46 pid: 5835 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.495962:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3738 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22664b expref: 46 pid: 5835 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.495979:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:1.0:1788940795.495984:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.495994:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.496003:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3762 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.496035:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940795.496084:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+45:2358:x1875840036052224:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 207us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940795.496092:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 65 00010000:00010000:2.0:1788940795.496228:0:7198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496238:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940795.496283:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788940795.496287:0:7198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940795.496307:0:7198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496320:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496331:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3754 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496338:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3754 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496361:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496368:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940795.496378:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496387:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3754 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496397:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:2.0:1788940795.496400:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940795.496404:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3754 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496411:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051400/0xa1d8aa9164aa3754 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496422:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa375b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496428:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa375b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496433:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa375b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496438:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940795.496441:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa375b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496448:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa375b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496456:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f41054d7200) 00010000:00010000:2.0:1788940795.496458:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940795.496470:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa375b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496476:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050e00/0xa1d8aa9164aa375b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496511:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050400/0xa1d8aa9164aa374d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226652 expref: 45 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496525:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226652 expref: 44 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.496532:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:2.0:1788940795.496534:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940795.496537:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6600, rc 0) 00000100:00100000:2.0:1788940795.496563:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+44:11436:x1875840036051840:12345-192.168.202.17@tcp:101:stat.0 Request processed in 10705us (10955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940795.496570:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 155 00000100:00100000:1.0:1788940795.554123:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940795.554552:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036052480 00000100:00100000:2.0:1788940795.554564:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036052480 00000100:00100000:2.0:1788940795.554631:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 156 00000100:00100000:2.0:1788940795.554641:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+44:11442:x1875840036052480:12345-192.168.202.17@tcp:36:truncate.0 00010000:00010000:2.0:1788940795.554719:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940795.554750:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3762 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226652 expref: 44 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.554771:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:2.0:1788940795.554776:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940795.555008:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3769 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.555023:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3769 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.555034:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3769 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940795.555081:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788940795.555105:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd3d3c9e reply state 00000000b03d663e transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3769 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940795.555114:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940795.555254:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+46:11442:x1875840036052480:12345-192.168.202.17@tcp:36:truncate.0 Request processed in 613us (1141us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788940795.555261:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 156 00000020:00080000:2.0:1788940795.555266:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788940795.556927:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3769 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.556941:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3769 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.556949:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3769 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.556955:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940795.556959:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3769 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.556968:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3769 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.556996:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:2.0:1788940795.556999:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940795.557004:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3769 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.557010:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3769 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940795.706148:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940795.706356:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036052608 00000100:00100000:0.0:1788940795.706369:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036052608 00000100:00100000:0.0:1788940795.706493:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 157 00000100:00100000:0.0:1788940795.706505:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+45:11456:x1875840036052608:12345-192.168.202.17@tcp:101:stat.0 00010000:00010000:0.0:1788940795.706546:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940795.706577:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3770 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226659 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706638:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3777 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706652:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3777 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706665:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3777 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706680:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa377e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706687:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa377e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706694:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa377e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706779:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3785 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706787:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706794:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940795.706829:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788940795.706839:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940795.706864:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706876:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706884:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3777 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706890:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3777 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706912:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3777 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706919:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940795.706924:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3777 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706933:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3777 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706945:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:0.0:1788940795.706948:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940795.706953:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3777 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706960:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa3777 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706974:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa377e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706989:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa377e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706994:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa377e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.706999:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940795.707002:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa377e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.707008:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa377e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.707015:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f410ad9f500) 00010000:00010000:0.0:1788940795.707018:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940795.707021:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa377e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.707026:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa377e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.707055:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa3770 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226659 expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.707068:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226659 expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.707083:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:0.0:1788940795.707086:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940795.707095:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235a00, rc 0) 00000100:00100000:0.0:1788940795.707161:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+46:11456:x1875840036052608:12345-192.168.202.17@tcp:101:stat.0 Request processed in 658us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940795.707168:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 157 00000100:00100000:3.0:1788940795.789303:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940795.790385:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036052864 00000100:00100000:2.0:1788940795.790398:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036052864 00000100:00100000:2.0:1788940795.790469:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 158 00000100:00100000:2.0:1788940795.790480:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+46:11466:x1875840036052864:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940795.790499:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940795.790520:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa378c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226660 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940795.790623:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788940795.790744:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa378c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226660 expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.790758:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:2.0:1788940795.790762:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940795.790768:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa378c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226660 expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.790782:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6e00, rc 0) 00000100:00100000:2.0:1788940795.790852:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+47:11466:x1875840036052864:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 373us (1560us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788940795.790875:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 158 00000100:00100000:3.0:1788940795.793436:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940795.793555:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036053120 00000100:00100000:0.0:1788940795.793566:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036053120 00000100:00100000:0.0:1788940795.793621:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 44 00000100:00100000:0.0:1788940795.793631:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41057c7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+47:11466:x1875840036053120:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:0.0:1788940795.794017:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41057c7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+48:11466:x1875840036053120:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 386us (589us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788940795.794025:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 44 00000100:00100000:1.0:1788940795.885317:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940795.885433:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036053376 00000100:00100000:2.0:1788940795.885450:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036053376 00000100:00100000:2.0:1788940795.885523:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 159 00000100:00100000:2.0:1788940795.885532:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+48:11472:x1875840036053376:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:2.0:1788940795.885555:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940795.885574:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa379a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226667 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.885675:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.885689:0:7198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3785 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226659 expref: 49 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.885698:0:7198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.885729:0:7198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226659 expref: 49 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.885741:0:7198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3785 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226659 expref: 49 pid: 5835 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940795.885754:0:7198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a695180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068564736:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940795.885847:0:7198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f179b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940795.895256:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940795.896041:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036053504 00000100:00100000:1.0:1788940795.896057:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036053504 00010000:00010000:1.0:1788940795.896116:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3785 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226659 expref: 50 pid: 5835 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940795.896226:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 66 00000100:00100000:1.0:1788940795.896240:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+50:2358:x1875840036053504:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940795.896262:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940795.896271:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3785 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226659 expref: 50 pid: 5835 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.896287:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3785 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226659 expref: 50 pid: 5835 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.896316:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:1.0:1788940795.896323:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.896335:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.896344:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940795.896369:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940795.896445:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+50:2358:x1875840036053504:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 208us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940795.896453:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 66 00010000:00010000:3.0:1788940795.899490:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3785 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226659 expref: 49 pid: 5835 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940795.899525:0:7198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a695180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068564736:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940795.899571:0:7198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.899584:0:7198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.899590:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940795.899621:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788940795.900041:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa379a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226667 expref: 50 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.900061:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226667 expref: 49 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.900072:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:3.0:1788940795.900075:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940795.900080:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7000, rc 0) 00000100:00100000:3.0:1788940795.900157:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+49:11472:x1875840036053376:12345-192.168.202.17@tcp:101:bash.0 Request processed in 14624us (14856us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1788940795.900168:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 159 00000100:00100000:3.0:1788940795.906085:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940795.906230:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036053760 00000100:00100000:2.0:1788940795.906244:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036053760 00000100:00100000:2.0:1788940795.906323:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 160 00000100:00100000:2.0:1788940795.906337:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+49:11472:x1875840036053760:12345-192.168.202.17@tcp:36:bash.0 00010000:00010000:2.0:1788940795.906705:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37af lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.906728:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.906742:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940795.906806:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788940795.906833:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c662611 reply state 0000000072d2d7fe transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940795.906844:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940795.906968:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+52:11472:x1875840036053760:12345-192.168.202.17@tcp:36:bash.0 Request processed in 633us (896us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788940795.906977:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 160 00000020:00080000:2.0:1788940795.906983:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788940795.921208:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.921236:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.921245:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.921253:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940795.921281:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.921292:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.921315:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:2.0:1788940795.921318:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940795.921324:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37af lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.921332:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37af lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940795.924237:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940795.924306:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036053888 00000100:00100000:0.0:1788940795.924321:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036053888 00000100:00100000:0.0:1788940795.924398:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 161 00000100:00100000:0.0:1788940795.924412:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+51:11472:x1875840036053888:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:0.0:1788940795.924446:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940795.924475:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa37b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22666e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.924590:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa37bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.924608:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226667 expref: 52 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.924620:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa37bd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.924783:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226667 expref: 52 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940795.924798:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226667 expref: 52 pid: 7198 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940795.924815:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134c57480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068564864:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940795.924924:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a068f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940795.929036:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134c57480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068564864:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940795.929077:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa37bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940795.929312:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940795.930072:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036054016 00000100:00100000:3.0:1788940795.930085:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036054016 00010000:00010000:3.0:1788940795.930139:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226667 expref: 53 pid: 7198 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940795.930290:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 67 00000100:00100000:3.0:1788940795.930303:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+53:2359:x1875840036054016:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940795.930325:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940795.930333:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226667 expref: 53 pid: 7198 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.930364:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226667 expref: 53 pid: 7198 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.930393:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226667 expref: 53 pid: 7198 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.930415:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:3.0:1788940795.930421:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa37bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.930432:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa37bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.930442:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa37bd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940795.931070:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940795.931160:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+52:2359:x1875840036054016:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 855us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940795.931169:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 67 00010000:00010000:2.0:1788940795.931438:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa37bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.931450:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa37bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940795.931521:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788940795.931642:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940795.931674:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa37bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.931718:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa37b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22666e expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.931739:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa37bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22666e expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940795.931747:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:2.0:1788940795.931766:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940795.931770:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234000, rc 0) 00000100:00100000:2.0:1788940795.931807:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+52:11472:x1875840036053888:12345-192.168.202.17@tcp:101:bash.0 Request processed in 7399us (7647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940795.931815:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 161 00000100:00100000:0.0:1788940795.951815:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940795.952099:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036054272 00000100:00100000:2.0:1788940795.952113:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036054272 00000100:00100000:2.0:1788940795.952242:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 45 00000100:00100000:2.0:1788940795.952255:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+51:11472:x1875840036054272:12345-192.168.202.17@tcp:35:bash.0 00000100:00100000:2.0:1788940795.952748:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+52:11472:x1875840036054272:12345-192.168.202.17@tcp:35:bash.0 Request processed in 493us (946us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788940795.952758:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 45 00000100:00100000:1.0:1788940796.029428:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940796.029922:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036054528 00000100:00100000:0.0:1788940796.029939:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036054528 00000100:00100000:0.0:1788940796.030086:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 162 00000100:00100000:0.0:1788940796.030100:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+52:11482:x1875840036054528:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940796.030133:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940796.030163:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa37c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226675 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940796.030342:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788940796.030521:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa37c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226675 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.030553:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:0.0:1788940796.030557:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940796.030565:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa37c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226675 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.030609:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235a00, rc 0) 00000100:00100000:0.0:1788940796.030701:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+53:11482:x1875840036054528:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 604us (1290us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788940796.030710:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 162 00000100:00100000:3.0:1788940796.040783:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940796.050493:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036054656 00000100:00100000:2.0:1788940796.050515:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036054656 00000100:00100000:2.0:1788940796.050852:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 163 00000100:00100000:2.0:1788940796.050866:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+53:11482:x1875840036054656:12345-192.168.202.17@tcp:34:lfs.0 00010000:00010000:2.0:1788940796.050970:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.050993:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051007:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051026:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051034:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051064:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051219:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051231:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051238:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940796.051293:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051309:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051317:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051325:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051332:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940796.051337:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051346:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051361:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:2.0:1788940796.051371:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940796.051378:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051385:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051404:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051411:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051417:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051423:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940796.051426:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051433:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051440:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f41054d7200) 00010000:00010000:2.0:1788940796.051443:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940796.051446:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051452:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051788:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051801:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051806:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051812:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940796.051815:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051822:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051831:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:2.0:1788940796.051833:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940796.051837:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.051843:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940796.051998:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+53:11482:x1875840036054656:12345-192.168.202.17@tcp:34:lfs.0 Request processed in 1132us (11229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940796.052008:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 163 00000100:00100000:1.0:1788940796.061782:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940796.061820:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036054912 00000100:00100000:2.0:1788940796.061834:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036054912 00000100:00100000:2.0:1788940796.061912:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 46 00000100:00100000:2.0:1788940796.061925:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+53:11482:x1875840036054912:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:2.0:1788940796.062437:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+54:11482:x1875840036054912:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 514us (670us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788940796.062462:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 46 00000100:00100000:3.0:1788940796.097319:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940796.097471:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036055168 00000100:00100000:2.0:1788940796.097485:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036055168 00000100:00100000:2.0:1788940796.097567:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 164 00000100:00100000:2.0:1788940796.097580:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+54:11485:x1875840036055168:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940796.097615:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940796.097644:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22667c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.097749:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.097767:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.097780:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.097796:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.097803:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.097810:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.098089:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa37fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.098120:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa37fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.098128:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa37fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940796.098141:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788940796.098498:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098509:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098516:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098530:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940796.098536:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098545:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098560:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:3.0:1788940796.098563:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940796.098569:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098576:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa37ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098593:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098599:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098604:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098609:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940796.098612:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098618:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098636:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f41054d7200) 00010000:00010000:3.0:1788940796.098639:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940796.098642:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098649:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa37f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098708:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa37e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22667c expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098725:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa37fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22667c expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.098732:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:3.0:1788940796.098735:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940796.098738:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6a00, rc 0) 00000100:00100000:3.0:1788940796.098827:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:11485:x1875840036055168:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 1249us (1524us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788940796.098835:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 164 00000100:00100000:0.0:1788940796.101726:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940796.101908:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036055296 00000100:00100000:2.0:1788940796.101922:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036055296 00000100:00100000:2.0:1788940796.102001:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 165 00000100:00100000:2.0:1788940796.102014:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:11485:x1875840036055296:12345-192.168.202.17@tcp:54:lfs.0 00010000:00010000:2.0:1788940796.102107:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa380a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.102128:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa380a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.102142:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa380a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.102184:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa380a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.102294:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa380a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.102303:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa380a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.102310:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940796.102333:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa380a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.102342:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa380a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.102356:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:2.0:1788940796.102359:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940796.102366:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa380a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.102374:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa380a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940796.103021:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940796.103237:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036055424 00000100:00100000:1.0:1788940796.103244:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036055424 00000100:00100000:1.0:1788940796.103311:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00100000:1.0:1788940796.103320:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+57:2361:x1875840036055424:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940796.103335:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940796.103358:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa37fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22667c expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.103374:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:1.0:1788940796.103378:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940796.103441:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:2361:x1875840036055424:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 123us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940796.103448:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00100000:0.0:1788940796.104658:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:11485:x1875840036055296:12345-192.168.202.17@tcp:54:lfs.0 Request processed in 2637us (2937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940796.104672:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 165 00000100:00100000:3.0:1788940796.106385:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940796.106500:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036055680 00000100:00100000:2.0:1788940796.106513:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036055680 00000100:00100000:2.0:1788940796.106604:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 47 00000100:00100000:2.0:1788940796.106616:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:11485:x1875840036055680:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:2.0:1788940796.106937:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:11485:x1875840036055680:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 322us (562us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788940796.106946:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 47 00000100:00100000:3.0:1788940796.210721:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940796.210874:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036055936 00000100:00100000:1.0:1788940796.210890:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036055936 00000100:00100000:1.0:1788940796.210967:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 166 00000100:00100000:1.0:1788940796.210980:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:11503:x1875840036055936:12345-192.168.202.17@tcp:101:cat.0 00010000:00010000:1.0:1788940796.211024:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940796.211057:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa3811 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226683 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.211267:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa3818 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.211286:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa3818 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.211310:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa3818 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940796.211324:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788940796.211531:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5000/0xa1d8aa9164aa3811 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226683 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.211553:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa3818 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226683 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.211563:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:1.0:1788940796.211566:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788940796.211571:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4000, rc 0) 00000100:00100000:1.0:1788940796.211661:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+58:11503:x1875840036055936:12345-192.168.202.17@tcp:101:cat.0 Request processed in 683us (959us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788940796.211671:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 166 00000100:00100000:1.0:1788940796.235323:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940796.235494:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036056064 00000100:00100000:3.0:1788940796.235509:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036056064 00000100:00100000:3.0:1788940796.235715:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 167 00000100:00100000:3.0:1788940796.235729:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+58:11504:x1875840036056064:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:3.0:1788940796.235791:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940796.235821:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3826 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22668a expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.235931:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa382d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.235949:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa382d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.235965:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa382d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940796.236016:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788940796.236021:0:7198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940796.236045:0:7198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa382d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.236080:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa3826 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22668a expref: 60 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.236105:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa382d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22668a expref: 59 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.236117:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:3.0:1788940796.236119:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940796.236125:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36000, rc 0) 00000100:00100000:3.0:1788940796.236293:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+59:11504:x1875840036056064:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 566us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940796.236302:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 167 00000100:00100000:0.0:1788940796.243356:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940796.243489:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036056448 00000100:00100000:3.0:1788940796.243504:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036056448 00000100:00100000:3.0:1788940796.243588:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 48 00000100:00100000:3.0:1788940796.243601:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+59:11504:x1875840036056448:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:3.0:1788940796.244086:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:11504:x1875840036056448:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 483us (752us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788940796.244096:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 48 00000100:00100000:2.0:1788940796.247524:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940796.247877:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036056576 00000100:00100000:0.0:1788940796.247892:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036056576 00000100:00100000:0.0:1788940796.247982:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 14 00000100:00100000:0.0:1788940796.247996:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:11504:x1875840036056576:12345-192.168.202.17@tcp:103:lfs.0 00010000:00010000:0.0:1788940796.248018:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788940796.248053:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa37bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22666e expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.248084:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4000/0xa1d8aa9164aa3818 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226683 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.248099:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050600/0xa1d8aa9164aa36c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22662f expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.248112:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:0.0:1788940796.248128:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940796.248293:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+57:11504:x1875840036056576:12345-192.168.202.17@tcp:103:lfs.0 Request processed in 300us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940796.248302:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 14 00000100:00100000:1.0:1788940796.252111:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940796.252254:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036056704 00000100:00100000:2.0:1788940796.252268:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036056704 00000100:00100000:2.0:1788940796.252360:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 168 00000100:00100000:2.0:1788940796.252375:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+57:11504:x1875840036056704:12345-192.168.202.17@tcp:58:lfs.0 00010000:00010000:2.0:1788940796.252525:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3834 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.252559:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3834 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.252595:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3834 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940796.252888:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788940796.253002:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+57:11504:x1875840036056704:12345-192.168.202.17@tcp:58:lfs.0 Request processed in 631us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940796.253012:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 168 00000100:00100000:3.0:1788940796.272667:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940796.272895:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036056832 00000100:00100000:1.0:1788940796.272908:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036056832 00000100:00100000:1.0:1788940796.272977:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 169 00000100:00100000:1.0:1788940796.272988:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+57:11506:x1875840036056832:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:1.0:1788940796.273017:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940796.273043:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa383b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226691 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273125:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3842 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273142:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3842 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273155:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3842 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273239:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3849 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273247:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273254:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273374:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273383:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273390:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940796.273435:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788940796.273440:0:7198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940796.273459:0:7198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273471:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273480:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3842 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273487:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3842 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273506:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3842 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273513:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940796.273518:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3842 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273713:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3842 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273730:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:1.0:1788940796.273733:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940796.273739:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3842 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273746:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3842 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273762:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3849 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273769:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3849 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273774:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3849 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273780:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940796.273783:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3849 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273799:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3849 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273807:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f41129a4500) 00010000:00010000:1.0:1788940796.273809:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940796.273812:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3849 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273818:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3849 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273902:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa383b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226691 expref: 59 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273919:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226691 expref: 58 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.273928:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7900) 00010000:00010000:1.0:1788940796.273930:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940796.273933:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4400, rc 0) 00000100:00100000:1.0:1788940796.274017:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+58:11506:x1875840036056832:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 1030us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940796.274025:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 169 00010000:00010000:3.0:1788940796.488700:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788940796.521053:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967451 is committed 00000004:00080000:2.0:1788940796.521085:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788940796.521106:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f413a0689c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788940796.521112:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f4111523c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f413a0680c0 00000020:00080000:2.0:1788940796.521116:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f4111523f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f41115e1c00 00000001:00080000:2.0:1788940796.521155:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000001:00080000:2.0:1788940796.521265:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000100:00100000:3.0:1788940796.521332:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940796.521360:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068564992:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788940796.521457:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940796.521499:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068564992 00000100:00100000:1.0:1788940796.521510:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068564992 00000100:00100000:1.0:1788940796.521587:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000020:00080000:0.0:1788940796.521590:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:1.0:1788940796.521599:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1875840068564992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788940796.521632:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1788940796.521699:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa111f9, atime: 0x6aa111f9, ctime: 0x6aa111f9, blocks: 0x1 00010000:00010000:1.0:1788940796.521710:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3857 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.521730:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=437s v=(0 0) 00010000:00010000:1.0:1788940796.521735:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940796.521744:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3857 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.521764:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3857 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.521775:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3857 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.521785:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3857 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.521802:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1788940796.521808:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788940796.521924:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940796.521932:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3857 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.521941:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940796.521947:0:7621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3857 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.521957:0:7621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3857 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.521978:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3857 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.521985:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3857 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.522012:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940796.522014:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940796.522016:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940796.522780:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1875840068564992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1178us (1317us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788940796.522794:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1788940796.522826:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f413a6af800/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788940796.522834:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068564992:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1788940796.522875:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788940796.810701:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940796.810715:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940796.810808:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788940796.810817:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788940796.810996:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a6adc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875840068565120:192.168.202.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788940796.811127:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410f6e96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940796.823772:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940796.823817:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036056960 00000100:00100000:2.0:1788940796.823830:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036056960 00000100:00100000:2.0:1788940796.823902:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 170 00000100:00100000:2.0:1788940796.823915:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:11517:x1875840036056960:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788940796.823960:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788940796.824101:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:11517:x1875840036056960:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 Request processed in 188us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940796.824110:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 170 00000100:00100000:2.0:1788940796.824284:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a6adc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875840068565120:192.168.202.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788940796.833466:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940796.833519:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036057088 00000100:00100000:3.0:1788940796.833533:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036057088 00000100:00100000:3.0:1788940796.833618:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 171 00000100:00100000:3.0:1788940796.836759:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:11517:x1875840036057088:12345-192.168.202.17@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788940796.836890:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa385e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.836912:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa385e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.836932:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa385e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.836951:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3865 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.836971:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3865 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.836978:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3865 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.837014:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa386c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.837023:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa386c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.837030:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa386c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940796.837083:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788940796.837089:0:7198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940796.837105:0:7198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa386c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.837119:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa385e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.837127:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa385e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.837134:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa385e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.837141:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940796.837147:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa385e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.837163:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa385e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838615:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9fd00) 00010000:00010000:3.0:1788940796.838620:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940796.838629:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa385e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838647:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa385e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838665:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3865 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838673:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3865 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838680:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3865 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838686:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940796.838689:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3865 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838697:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3865 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838705:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8f4112cbf700) 00010000:00010000:3.0:1788940796.838707:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940796.838711:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3865 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838732:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa3865 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838756:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa386c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838762:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa386c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838769:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa386c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838774:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41421c2800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940796.838778:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa386c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838783:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa386c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838791:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7900) 00010000:00010000:3.0:1788940796.838793:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940796.838797:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa386c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.838802:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa386c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940796.838950:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:11517:x1875840036057088:12345-192.168.202.17@tcp:34:lhsmtool_posix.0 Request processed in 5314us (5493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940796.838963:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 171 00000100:00100000:2.0:1788940796.845099:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940796.846996:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036057344 00000100:00100000:0.0:1788940796.847017:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036057344 00000100:00100000:0.0:1788940796.847100:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 172 00000100:00100000:0.0:1788940796.847112:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+16:11517:x1875840036057344:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940796.847139:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940796.847177:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3873 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226698 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.847348:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa387a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.847368:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa387a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.847383:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa387a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940796.847398:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788940796.847878:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa387a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.847889:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa387a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.847896:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa387a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.847917:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940796.847923:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa387a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.847932:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa387a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.847948:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7900) 00010000:00010000:0.0:1788940796.847952:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940796.847958:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa387a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.847965:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa387a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.848021:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3873 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226698 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.848032:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9fd00) 00010000:00010000:0.0:1788940796.848035:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940796.848039:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3873 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226698 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.848049:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235a00, rc 0) 00000100:00100000:0.0:1788940796.848146:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:11517:x1875840036057344:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 1036us (3065us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788940796.848156:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 172 00000100:00100000:0.0:1788940796.855744:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940796.856248:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036057472 00000100:00100000:2.0:1788940796.856264:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036057472 00000100:00100000:2.0:1788940796.856344:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 173 00000100:00100000:2.0:1788940796.856357:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:11517:x1875840036057472:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788940796.856406:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788940796.856634:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:11517:x1875840036057472:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 Request processed in 279us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940796.856643:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 173 00000100:00100000:1.0:1788940796.869559:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940796.869823:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036057728 00000100:00100000:0.0:1788940796.869838:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036057728 00000100:00100000:0.0:1788940796.869909:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 174 00000100:00100000:0.0:1788940796.869921:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:11517:x1875840036057728:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940796.869946:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940796.869951:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788940796.869985:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa382d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22668a expref: 17 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.870022:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:0.0:1788940796.870029:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940796.870045:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3888 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22669f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788940796.873291:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788940796.876405:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa388f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.876442:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa388f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.876460:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa388f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.877831:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa3888 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22669f expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.877866:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa388f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22669f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.877891:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f410ad9f500) 00010000:00010000:0.0:1788940796.877895:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940796.877899:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235c00, rc 0) 00000100:00100000:0.0:1788940796.878006:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:11517:x1875840036057728:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 8084us (8469us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788940796.878018:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 174 00000100:00100000:1.0:1788940796.897406:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940796.897634:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036057984 00000100:00100000:2.0:1788940796.897648:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036057984 00000100:00100000:2.0:1788940796.897716:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 175 00000100:00100000:2.0:1788940796.897729:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:11517:x1875840036057984:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788940796.897801:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940796.897835:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa388f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22669f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.897856:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f410ad9f500) 00010000:00010000:2.0:1788940796.897869:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940796.897895:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa389d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.897911:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa389d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.897923:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa389d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.900664:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x246d45a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.900687:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x246d45a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.900702:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x246d45a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.902470:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa389d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.902489:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa389d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.902497:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa389d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.902504:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940796.902508:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa389d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.902518:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa389d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.902538:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:2.0:1788940796.902541:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940796.902546:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa389d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.902552:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa389d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.902580:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x246d45a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.902586:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x246d45a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.902592:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x246d45a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.902598:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940796.902601:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x246d45a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.902607:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x246d45a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.902615:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x246d45a (ffff8f41054d7e00) 00010000:00010000:2.0:1788940796.902617:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940796.902620:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x246d45a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.902626:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x246d45a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940796.902763:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:11517:x1875840036057984:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 5026us (5362us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940796.902778:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 175 00000100:00100000:3.0:1788940796.905885:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940796.908130:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036058112 00000100:00100000:2.0:1788940796.908159:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036058112 00000100:00100000:2.0:1788940796.908273:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 176 00000100:00100000:3.0:1788940796.908408:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:11517:x1875840036058112:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940796.908441:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940796.908474:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa38ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2266a6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.908534:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa38b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.908551:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa38b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.908638:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa38b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.908764:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa38ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266a6 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.908788:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa38b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266a6 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.908798:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4112cbf700) 00010000:00010000:3.0:1788940796.908801:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788940796.908806:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36000, rc 0) 00000100:00100000:3.0:1788940796.908901:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:11517:x1875840036058112:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 608us (3034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940796.908912:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 176 00000100:00100000:0.0:1788940796.916677:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940796.916888:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036058368 00000100:00100000:3.0:1788940796.916911:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036058368 00000100:00100000:3.0:1788940796.916990:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 177 00000100:00100000:3.0:1788940796.917003:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:11517:x1875840036058368:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940796.917120:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa38b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.917143:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa38b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940796.917156:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa38b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940796.917642:0:7198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788940796.917657:0:7198:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 438221468818ns, next at 439221465322ns, rc = 0 00000004:00010000:3.0:1788940796.917769:0:7198:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004230d53f reply state 000000008a3f5401 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa38b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940796.917781:0:7198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940796.917905:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:11517:x1875840036058368:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 903us (1242us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788940796.917914:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 177 00010000:00010000:1.0:1788940796.922685:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa38b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.922707:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa38b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.922726:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa38b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.922733:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940796.922740:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa38b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.922750:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa38b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.922770:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4112cbf700) 00010000:00010000:1.0:1788940796.922774:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788940796.922780:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa38b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940796.922788:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa38b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940796.923725:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940796.923828:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036058496 00000100:00100000:2.0:1788940796.923843:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036058496 00000100:00100000:2.0:1788940796.923919:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 178 00000100:00100000:2.0:1788940796.923939:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:11517:x1875840036058496:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940796.923974:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940796.923998:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2266ad expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.924078:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266ad expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.924096:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266ad expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940796.924120:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4112cbf700) 00010000:00010000:2.0:1788940796.924124:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940796.924128:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7000, rc 0) 00000100:00100000:2.0:1788940796.924257:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:11517:x1875840036058496:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 325us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940796.924265:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 178 00000100:00100000:1.0:1788940796.935114:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940796.939226:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036058624 00000100:00100000:0.0:1788940796.939250:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036058624 00000100:00100000:0.0:1788940796.939338:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 51 00000100:00100000:0.0:1788940796.939351:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840036058624:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788940796.941143:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036058624:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 Request processed in 1782us (6031us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788940796.941158:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 51 00000100:00100000:3.0:1788940796.959858:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940796.959947:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036058880 00000100:00100000:1.0:1788940796.959969:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036058880 00000100:00100000:1.0:1788940796.960082:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 49 00000100:00100000:1.0:1788940796.960095:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:11517:x1875840036058880:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788940796.960540:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:11517:x1875840036058880:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 Request processed in 446us (690us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788940796.960693:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 49 00000100:00100000:1.0:1788940796.962995:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940796.963178:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036059136 00000100:00100000:2.0:1788940796.963213:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036059136 00000100:00100000:2.0:1788940796.963286:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 179 00000100:00100000:2.0:1788940796.963299:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:11517:x1875840036059136:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788940796.963446:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41012ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:11517:x1875840036059136:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 149us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940796.963468:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 179 00000100:00100000:2.0:1788940796.980502:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940796.980670:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036059264 00000100:00100000:0.0:1788940796.980684:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036059264 00000100:00100000:0.0:1788940796.980762:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 180 00000100:00100000:0.0:1788940796.980775:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:11517:x1875840036059264:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940796.980806:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940796.980839:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa38c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2266b4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.980951:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa38ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.980997:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa38ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.981014:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa38ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940796.981067:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940796.981092:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa38ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.981128:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa38c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266b4 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.981156:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa38ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266b4 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.981176:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4112cbf700) 00010000:00010000:0.0:1788940796.981180:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788940796.981249:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136234000, rc 0) 00000100:00100000:0.0:1788940796.981330:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:11517:x1875840036059264:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 555us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940796.981339:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 180 00000100:00100000:3.0:1788940796.983921:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940796.984351:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036059392 00000100:00100000:0.0:1788940796.984372:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036059392 00000100:00100000:0.0:1788940796.984443:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 52 00000100:00100000:0.0:1788940796.984465:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2358:x1875840036059392:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940796.984489:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940796.984539:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e485753/0xa1d8aa9164aa38d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2266bb expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940796.984576:0:6671:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa111fc, blocks: 0x1 00010000:00010000:0.0:1788940796.984605:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1788940796.984611:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940796.984633:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e485753/0xa1d8aa9164aa38d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266bb expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.984659:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e485753/0xa1d8aa9164aa38d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266bb expref: 8 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940796.984676:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235a00, rc 0) 00000100:00100000:0.0:1788940796.984764:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2358:x1875840036059392:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 301us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940796.984773:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 52 00000100:00100000:0.0:1788940796.993044:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940796.993159:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036059648 00000100:00100000:3.0:1788940796.993180:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036059648 00000100:00100000:3.0:1788940796.993261:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 181 00000100:00100000:3.0:1788940796.993274:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:11517:x1875840036059648:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788940796.993498:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:11517:x1875840036059648:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 226us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940796.993531:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 181 00000100:00100000:2.0:1788940796.999671:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940796.999836:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036059776 00000100:00100000:0.0:1788940796.999852:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036059776 00000100:00100000:0.0:1788940796.999938:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 53 00000100:00100000:0.0:1788940796.999952:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:11517:x1875840036059776:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940796.999979:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940797.000003:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066b7a420/0xa1d8aa9164aa38dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2266c2 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.000052:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e485753/0xa1d8aa9164aa38d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266bb expref: 9 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.000076:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940797.000081:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940797.000088:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066b7a420/0xa1d8aa9164aa38dc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c2 expref: 9 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.000135:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e485753/0xa1d8aa9164aa38d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266bb expref: 9 pid: 6671 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.000153:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e485753/0xa1d8aa9164aa38d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266bb expref: 9 pid: 6671 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940797.000181:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134c54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6673:1875840068565248:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940797.000326:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a068cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940797.010641:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940797.011762:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036059904 00000100:00100000:3.0:1788940797.011781:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036059904 00010000:00010000:3.0:1788940797.011865:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e485753/0xa1d8aa9164aa38d5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266bb expref: 10 pid: 6671 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940797.011918:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 68 00000100:00100000:3.0:1788940797.011934:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41080e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:2358:x1875840036059904:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940797.011955:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940797.011990:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e485753/0xa1d8aa9164aa38d5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266bb expref: 10 pid: 6671 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.012009:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e485753/0xa1d8aa9164aa38d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266bb expref: 10 pid: 6671 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.012044:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940797.012050:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940797.012062:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000066b7a420/0xa1d8aa9164aa38dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c2 expref: 10 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.012074:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066b7a420/0xa1d8aa9164aa38dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c2 expref: 10 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.012124:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000066b7a420/0xa1d8aa9164aa38dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c2 expref: 10 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940797.012160:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a6adf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5819:1875840068565376:192.168.202.17@tcp:105: 00000100:00100000:3.0:1788940797.012309:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7cb40 going to sleep for 11 seconds 00000100:00080000:0.0:1788940797.016614:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940797.017829:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a6adf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5819:1875840068565376:192.168.202.17@tcp:105: 00010000:00010000:3.0:1788940797.017868:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940797.017934:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41080e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:2358:x1875840036059904:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 6005us (7318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940797.017948:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 68 00010000:00010000:1.0:1788940797.020338:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e485753/0xa1d8aa9164aa38d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266bb expref: 9 pid: 6671 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940797.020387:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134c54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6673:1875840068565248:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940797.020430:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066b7a420/0xa1d8aa9164aa38dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c2 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.021564:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235e00, rc 0) 00000100:00100000:0.0:1788940797.022019:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:11517:x1875840036059776:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 22063us (22356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940797.022032:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 53 00000100:00100000:0.0:1788940797.027026:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940797.027376:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036060032 00000100:00100000:1.0:1788940797.027391:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036060032 00002000:00100000:1.0:1788940797.027462:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8f4134c57100 x1875840036060032/t0(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:18/0 lens 504/0 e 0 to 0 dl 1788940808 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940797.027475:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f4134c57100 with x1875840036060032 ext(0->8) 00002000:00010000:1.0:1788940797.027482:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f4134c57100 00000100:00100000:1.0:1788940797.027519:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 4 00000100:00100000:1.0:1788940797.027533:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2358:x1875840036060032:12345-192.168.202.17@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788940797.031607:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:2358:x1875840036060032:12345-192.168.202.17@tcp:4:lhsmtool_posix.0 Request processed in 4060us (4581us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788940797.031625:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 4 00002000:00100000:1.0:1788940797.031643:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8f4134c57100 x1875840036060032/t4294967314(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:18/0 lens 504/448 e 0 to 0 dl 1788940808 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940797.031654:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f4134c57100 with x1875840036060032 ext(0->8) 00002000:00010000:1.0:1788940797.031662:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f4134c57100 00000100:00100000:3.0:1788940797.035314:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940797.035576:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036060160 00000100:00100000:0.0:1788940797.035591:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036060160 00000100:00100000:0.0:1788940797.035700:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 182 00000100:00100000:0.0:1788940797.035712:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:11517:x1875840036060160:12345-192.168.202.17@tcp:44:lhsmtool_posix.0 00000100:00080000:1.0:1788940797.036103:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788940797.126932:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000020:00080000:2.0:1788940797.126961:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1788940797.126987:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788940797.127002:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:2.0:1788940797.127018:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1788940797.127046:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:2.0:1788940797.127425:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940797.127451:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068565504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788940797.127566:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940797.127650:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068565504 00000100:00100000:2.0:1788940797.127660:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068565504 00000100:00100000:2.0:1788940797.127761:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788940797.127773:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068565504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788940797.127997:0:6671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788940797.128002:0:6671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788940796 00002000:00010000:2.0:1788940797.128005:0:6671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788940797.128007:0:6671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788940796 -> 1788940796 00002000:00010000:2.0:1788940797.128010:0:6671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788940797.128060:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1875840068565504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 290us (501us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788940797.128068:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788940797.128465:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788940797.128523:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f413a697800/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788940797.128532:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068565504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788940797.128901:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:11517:x1875840036060160:12345-192.168.202.17@tcp:44:lhsmtool_posix.0 Request processed in 93187us (93599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940797.128921:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 182 00000100:00100000:0.0:1788940797.132672:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940797.132985:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036060288 00000100:00100000:3.0:1788940797.133000:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036060288 00000100:00100000:3.0:1788940797.133073:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 55 00000100:00100000:3.0:1788940797.133084:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:2359:x1875840036060288:12345-192.168.202.17@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788940797.224816:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:2359:x1875840036060288:12345-192.168.202.17@tcp:16:lhsmtool_posix.0 Request processed in 91711us (92136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940797.224835:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 55 00000001:00080000:3.0:1788940797.224893:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1788940797.224907:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:3.0:1788940797.224917:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1788940797.237919:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940797.238223:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036060544 00000100:00100000:0.0:1788940797.238240:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036060544 00000100:00100000:0.0:1788940797.238325:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 183 00000100:00100000:0.0:1788940797.238337:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:11517:x1875840036060544:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788940797.238414:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940797.238451:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa38ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266b4 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.238473:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4112cbf700) 00010000:00010000:0.0:1788940797.238479:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940797.238520:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa38e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.238537:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa38e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.238550:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa38e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940797.238894:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d41c3f17 reply state 000000007ffa783f transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa38e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940797.238905:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940797.241108:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:11517:x1875840036060544:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 2760us (3190us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788940797.241122:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 183 00010000:00010000:3.0:1788940797.255822:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa38e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.255848:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa38e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.255856:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa38e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.255874:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940797.255879:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa38e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.255887:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa38e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.255910:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4112cbf700) 00010000:00010000:3.0:1788940797.255912:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940797.255918:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa38e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.255924:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa38e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940797.256430:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940797.256695:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036060672 00000100:00100000:2.0:1788940797.256711:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036060672 00000100:00100000:2.0:1788940797.256809:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 56 00000100:00100000:2.0:1788940797.256822:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2358:x1875840036060672:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788940797.258822:0:6671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788940797.258833:0:6671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788940796 -> 1788940795 00002000:00010000:2.0:1788940797.258837:0:6671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788940793 00002000:00010000:2.0:1788940797.258848:0:6671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788940796 -> 1788940795 00002000:00010000:2.0:1788940797.258851:0:6671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788940797.259159:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2358:x1875840036060672:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 Request processed in 2332us (2728us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788940797.259180:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 56 00000100:00100000:3.0:1788940797.266130:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940797.266209:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036060928 00000100:00100000:3.0:1788940797.266226:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036060928 00000100:00100000:3.0:1788940797.266305:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 184 00000100:00100000:3.0:1788940797.266317:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:11517:x1875840036060928:12345-192.168.202.17@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788940797.266413:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.266434:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa38b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266a6 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.266445:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.266505:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa38b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266a6 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.266980:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa38b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266a6 expref: 18 pid: 5835 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940797.267003:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a6ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875840068565632:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940797.267125:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110f4f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788940797.275874:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a6ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875840068565632:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940797.275924:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940797.276784:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940797.276946:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036061056 00000100:00100000:0.0:1788940797.276964:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036061056 00010000:00010000:0.0:1788940797.277020:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa38b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266a6 expref: 19 pid: 5835 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940797.277136:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 69 00000100:00100000:0.0:1788940797.277152:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:2358:x1875840036061056:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940797.277181:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940797.277231:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa38b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266a6 expref: 19 pid: 5835 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.277254:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa38b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266a6 expref: 19 pid: 5835 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.277281:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa38b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266a6 expref: 19 pid: 5835 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.277303:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4112cbf700) 00010000:00010000:0.0:1788940797.277309:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.277320:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.277329:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.277371:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940797.277398:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.277410:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940797.277458:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:2358:x1875840036061056:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 310us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940797.277466:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 69 00010000:00010000:3.0:1788940797.277569:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.277581:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.277588:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.277594:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940797.277609:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.277617:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.277631:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4112cbf700) 00010000:00010000:3.0:1788940797.277634:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788940797.277639:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.277645:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa38ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940797.277718:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:11517:x1875840036060928:12345-192.168.202.17@tcp:55:lhsmtool_posix.0 Request processed in 11400us (11602us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788940797.277729:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 184 00000100:00100000:2.0:1788940797.280888:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940797.281058:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036061184 00000100:00100000:3.0:1788940797.281072:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036061184 00000100:00100000:3.0:1788940797.281205:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 57 00000100:00100000:3.0:1788940797.281218:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2359:x1875840036061184:12345-192.168.202.17@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788940797.281274:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa38f1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.281299:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066b7a420/0xa1d8aa9164aa38dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c2 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.281307:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940797.281312:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940797.281330:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa38f1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.281373:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066b7a420/0xa1d8aa9164aa38dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c2 expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.281388:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066b7a420/0xa1d8aa9164aa38dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c2 expref: 8 pid: 6673 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940797.281405:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a6ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6673:1875840068565760:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940797.281683:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110f4f480 going to sleep for 11 seconds 00000040:00080000:1.0:1788940797.283075:0:12453:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940797.283085:0:12453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940797.283389:0:12453:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788940797.283396:0:12453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788940797.287232:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a6ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6673:1875840068565760:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940797.287279:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa38f1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940797.292647:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940797.292743:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036061312 00000100:00100000:3.0:1788940797.292757:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036061312 00010000:00010000:3.0:1788940797.292814:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066b7a420/0xa1d8aa9164aa38dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c2 expref: 9 pid: 6673 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940797.292871:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 70 00000100:00100000:3.0:1788940797.292883:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2358:x1875840036061312:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940797.292902:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940797.292931:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066b7a420/0xa1d8aa9164aa38dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c2 expref: 9 pid: 6673 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.292947:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066b7a420/0xa1d8aa9164aa38dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c2 expref: 9 pid: 6673 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.292979:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066b7a420/0xa1d8aa9164aa38dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c2 expref: 9 pid: 6673 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.293013:0:7622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940797.293018:0:7622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940797.293024:0:7622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa38f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.293035:0:7622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa38f1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.293071:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940797.293135:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2358:x1875840036061312:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 254us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940797.293143:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 70 00010000:00010000:0.0:1788940797.297276:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa38f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.297299:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa38f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.297404:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa38f1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.297414:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa38f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.297424:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa38f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.297432:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36600 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940797.297437:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa38f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.297447:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa38f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.297469:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa38f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.297499:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa38f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940797.297608:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036061184:12345-192.168.202.17@tcp:1:lhsmtool_posix.0 Request processed in 16389us (16730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940797.297619:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 57 00000100:00100000:2.0:1788940797.314208:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940797.314279:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036061568 00000100:00100000:2.0:1788940797.314293:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036061568 00000100:00100000:2.0:1788940797.314364:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 185 00000100:00100000:2.0:1788940797.314375:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+17:11517:x1875840036061568:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788940797.314498:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa38f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.314728:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa38f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.314745:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa38f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.315039:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.315075:0:7198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266ad expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.315084:0:7198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.315128:0:7198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266ad expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.315145:0:7198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266ad expref: 18 pid: 5833 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940797.315160:0:7198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a694000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068565888:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940797.315323:0:7198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f412baefe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788940797.322470:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940797.322596:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036061696 00000100:00100000:1.0:1788940797.322606:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036061696 00010000:00010000:1.0:1788940797.322653:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38c0 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266ad expref: 19 pid: 5833 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940797.322744:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 71 00000100:00100000:1.0:1788940797.322757:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:2359:x1875840036061696:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940797.322776:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940797.322784:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38c0 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266ad expref: 19 pid: 5833 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.322802:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266ad expref: 19 pid: 5833 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940797.322807:0:7198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a694000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068565888:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940797.322843:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa38c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266ad expref: 19 pid: 5833 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.322855:0:7198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.322865:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4112cbf700) 00010000:00010000:1.0:1788940797.322873:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.322902:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.322910:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.331497:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940797.331712:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:2359:x1875840036061696:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 8943us (9356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940797.331730:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 71 00010000:00010000:2.0:1788940797.331832:0:7198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.331844:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940797.332103:0:7198:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1788940797.332307:0:7198:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788940797.332354:0:7198:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1788940797.332473:0:7198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a694000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7198:1875840068566016:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788940797.332575:0:7198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940797.332616:0:7198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f412baef780 going to sleep for 11 seconds 00000100:00100000:0.0:1788940797.332724:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068566016 00000100:00100000:0.0:1788940797.332735:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068566016 00000100:00100000:0.0:1788940797.332798:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940797.332811:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7198:x1875840068566016:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788940797.332924:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7198:x1875840068566016:12345-0@lo:1000:mdt00_003.0 Request processed in 115us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940797.332932:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788940797.333052:0:7198:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788940797.333072:0:7198:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f413a697800, transno 4294967315 00000100:00100000:1.0:1788940797.333095:0:7198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a694000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7198:1875840068566016:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788940797.339008:0:7198:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788940797.339134:0:7198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f400261c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7198:1875840068566144:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788940797.340421:0:7198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940797.340597:0:7198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4101359240 going to sleep for 11 seconds 00000100:00100000:0.0:1788940797.341355:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068566144 00000100:00100000:0.0:1788940797.341371:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068566144 00000100:00100000:0.0:1788940797.341460:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940797.341473:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7198:x1875840068566144:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788940797.341849:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7198:x1875840068566144:12345-0@lo:1000:mdt00_003.0 Request processed in 378us (1432us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788940797.341857:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940797.349503:0:7198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f400261c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7198:1875840068566144:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788940797.349585:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349599:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349608:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349615:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940797.349621:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349630:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349675:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f4112cbf700) 00010000:00010000:1.0:1788940797.349679:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940797.349686:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349693:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa38ff lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349737:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3834 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349745:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3834 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349750:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3834 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349755:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940797.349758:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3834 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349763:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3834 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349770:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7900) 00010000:00010000:1.0:1788940797.349773:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940797.349776:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3834 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349781:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3834 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349816:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349832:0:7198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3850 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226691 expref: 21 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349842:0:7198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349890:0:7198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226691 expref: 21 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940797.349908:0:7198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3850 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226691 expref: 21 pid: 7198 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940797.349923:0:7198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f400261f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068566272:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940797.350045:0:7198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110767180 going to sleep for 11 seconds 00000100:00100000:0.0:1788940797.369513:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940797.369569:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036061824 00000100:00100000:0.0:1788940797.369580:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036061824 00010000:00010000:0.0:1788940797.369636:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3850 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226691 expref: 22 pid: 7198 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940797.369684:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 72 00000100:00100000:0.0:1788940797.369695:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:2359:x1875840036061824:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940797.369715:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940797.369723:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3850 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226691 expref: 22 pid: 7198 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.369739:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3850 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226691 expref: 22 pid: 7198 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.369765:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7900) 00010000:00010000:0.0:1788940797.369772:0:7622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.369784:0:7622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.369793:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.369818:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940797.369885:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:2359:x1875840036061824:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 191us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940797.369893:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 72 00010000:00010000:3.0:1788940797.370143:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3850 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226691 expref: 21 pid: 7198 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940797.370224:0:7198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f400261f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068566272:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940797.370270:0:7198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370281:0:7198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370289:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370304:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370330:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370350:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370358:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940797.370364:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370373:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370389:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7900) 00010000:00010000:3.0:1788940797.370392:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940797.370398:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370415:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3906 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370431:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa38f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370437:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa38f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370456:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa38f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370463:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940797.370476:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa38f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370483:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa38f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370493:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7900) 00010000:00010000:3.0:1788940797.370495:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788940797.370498:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa38f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940797.370512:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa38f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940797.379353:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:11517:x1875840036061568:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 64963us (65157us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788940797.379372:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 185 00000020:00080000:2.0:1788940797.379382:0:7198:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788940797.382502:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940797.384991:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036062080 00000100:00100000:3.0:1788940797.385010:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036062080 00000100:00100000:2.0:1788940797.386551:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 50 00000100:00100000:2.0:1788940797.386574:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41057c7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:11517:x1875840036062080:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788940797.387459:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788940797.387589:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788940797.387648:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa390d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.387671:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa390d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.387686:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa390d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.387696:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa390d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.387704:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa390d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.387711:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa390d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940797.387735:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788940797.387881:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41057c7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:11517:x1875840036062080:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 Request processed in 1312us (5393us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788940797.387901:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 50 00000020:00080000:2.0:1788940797.387908:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788940797.389970:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940797.389987:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa390d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.390002:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7200 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940797.390008:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa390d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.390021:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa390d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.390048:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8f41054d7e00) 00010000:00010000:0.0:1788940797.390052:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788940797.390060:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa390d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.390065:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa390d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940797.390089:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940797.390091:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940797.390093:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940797.515083:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788940797.534389:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1788940797.534416:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1788940797.534424:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1788940797.960809:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068566400:0@lo:400:kworker.0 00000100:00100000:0.0:1788940797.960929:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940797.961062:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068566400 00000100:00100000:1.0:1788940797.961073:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068566400 00000100:00100000:1.0:1788940797.961130:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788940797.961140:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068566400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940797.961314:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068566528:0@lo:400:kworker.0 00000100:00100000:3.0:1788940797.961353:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940797.961396:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068566528 00000100:00100000:1.0:1788940797.961406:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3303:x1875840068566400:12345-0@lo:400:kworker.0 Request processed in 267us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940797.961415:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788940797.961460:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068566528 00000100:00100000:3.0:1788940797.961500:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788940797.961507:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068566528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940797.961696:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068566784:0@lo:400:kworker.0 00000100:00100000:2.0:1788940797.961736:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940797.961760:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940797.961766:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068566656:0@lo:400:kworker.0 00000100:00100000:3.0:1788940797.961777:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068566528:12345-0@lo:400:kworker.0 Request processed in 271us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940797.961784:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788940797.961786:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940797.961799:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068566656 00000100:00100000:3.0:1788940797.961803:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068566656 00000100:00080000:2.0:1788940797.961829:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940797.961835:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788940797.961841:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068566656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940797.961851:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068567040:0@lo:400:kworker.0 00000100:00100000:3.0:1788940797.961873:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068566656:12345-0@lo:400:kworker.0 Request processed in 32us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940797.961873:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940797.961888:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788940797.961908:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068566784 00000100:00100000:2.0:1788940797.961908:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a696d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068566528:0@lo:400:kworker.0 00000100:00100000:3.0:1788940797.961911:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068566784 00000100:00100000:2.0:1788940797.961927:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788940797.961932:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068566912:0@lo:400:kworker.0 00000100:00100000:3.0:1788940797.961934:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068567040 00000100:00100000:3.0:1788940797.961936:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068567040 00000100:00100000:3.0:1788940797.961956:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788940797.961956:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940797.961962:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1875840068566784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940797.961979:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788940797.961987:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068567040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940797.961991:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1875840068566784:12345-0@lo:400:kworker.0 Request processed in 31us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940797.961997:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788940797.962019:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068567040:12345-0@lo:400:kworker.0 Request processed in 34us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940797.962022:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068566656:0@lo:400:kworker.0 00000100:00100000:2.0:1788940797.962026:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788940797.962031:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068566784:0@lo:400:kworker.0 00000100:00100000:2.0:1788940797.962046:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068566912 00000100:00100000:2.0:1788940797.962049:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068566912 00000100:00100000:3.0:1788940797.962057:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1788940797.962063:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000100:00100000:2.0:1788940797.962075:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000004:00080000:3.0:1788940797.962081:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f413a6af800, transno 4294967307 00000100:00100000:2.0:1788940797.962081:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068566912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940797.962092:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068567040:0@lo:400:kworker.0 00000100:00100000:2.0:1788940797.962113:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068566912:12345-0@lo:400:kworker.0 Request processed in 33us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940797.962127:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1788940797.962143:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940797.962182:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068566912:0@lo:400:kworker.0 00000100:00100000:0.0:1788940797.962898:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a697800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068566400:0@lo:400:kworker.0 00000040:00080000:1.0:1788940798.408915:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940798.408933:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940798.411407:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788940798.411443:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788940798.474770:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940798.474806:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f400261e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068567168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940798.474912:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940798.475083:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068567168 00000100:00100000:1.0:1788940798.475094:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068567168 00000100:00100000:1.0:1788940798.475227:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788940798.475242:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068567168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940798.475291:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940798.475352:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068567168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940798.475361:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788940798.475431:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940798.475527:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f400261e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068567168:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940798.536443:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940799.382478:0:12505:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940799.382500:0:12505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940799.382550:0:12505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788940799.382560:0:12505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788940799.547257:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940799.547390:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036062336 00000100:00100000:0.0:1788940799.547409:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036062336 00000100:00080000:3.0:1788940799.547488:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940799.547515:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 186 00000100:00100000:0.0:1788940799.547530:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:11536:x1875840036062336:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940799.547581:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940799.547612:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa3914 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2266c9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.547745:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa391b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.547761:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa391b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.547775:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa391b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940799.547786:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788940799.548331:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa3914 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c9 expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.548356:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa391b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c9 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.548366:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:0.0:1788940799.548369:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788940799.548373:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235e00, rc 0) 00000100:00100000:0.0:1788940799.548453:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:11536:x1875840036062336:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 928us (1216us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788940799.548462:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 186 00000100:00100000:3.0:1788940799.552054:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940799.552169:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036062464 00000100:00100000:2.0:1788940799.552352:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036062464 00000100:00100000:2.0:1788940799.552435:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 187 00000100:00100000:2.0:1788940799.552446:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:11536:x1875840036062464:12345-192.168.202.17@tcp:34:lfs.0 00010000:00010000:2.0:1788940799.552525:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3929 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552543:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3929 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552554:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3929 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552571:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3930 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552578:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552584:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552852:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552861:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552875:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788940799.552923:0:7198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552936:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3929 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552942:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3929 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552949:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3929 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552956:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940799.552961:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3929 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552969:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3929 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552982:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:2.0:1788940799.552985:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940799.552990:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3929 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.552995:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3929 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.553006:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.553017:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3930 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.553023:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.553027:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940799.553030:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.553036:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3930 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.553044:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f41054d7c00) 00010000:00010000:2.0:1788940799.553046:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940799.553049:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3930 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.553054:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3930 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.553070:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.553076:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3937 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.553082:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.553088:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940799.553097:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.553103:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.553111:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7200) 00010000:00010000:2.0:1788940799.553113:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940799.553116:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3937 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.553123:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940799.553247:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:11536:x1875840036062464:12345-192.168.202.17@tcp:34:lfs.0 Request processed in 802us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940799.553255:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 187 00010000:00010000:0.0:1788940799.560344:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940799.609689:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940799.609820:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036062720 00000100:00100000:2.0:1788940799.609840:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036062720 00000100:00100000:2.0:1788940799.609948:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 188 00000100:00100000:2.0:1788940799.609966:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+24:11539:x1875840036062720:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940799.609996:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940799.610022:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa393e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2266d0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610105:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3945 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610137:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3945 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610172:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3945 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610225:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa394c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610234:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa394c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610240:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa394c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610556:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3953 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610565:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610573:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940799.610583:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788940799.610686:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3945 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610695:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3945 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610702:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3945 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610844:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940799.610856:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3945 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610865:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3945 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610879:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:2.0:1788940799.610882:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940799.610888:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3945 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610895:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa3945 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610909:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa394c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610914:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa394c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610920:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa394c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610924:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940799.610927:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa394c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610933:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa394c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610940:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f41054d7200) 00010000:00010000:2.0:1788940799.610942:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940799.610952:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa394c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.610958:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa394c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.611004:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa393e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d0 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.611018:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d0 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.611026:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7c00) 00010000:00010000:2.0:1788940799.611028:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940799.611030:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6600, rc 0) 00000100:00100000:2.0:1788940799.611112:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:11539:x1875840036062720:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 1152us (1441us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788940799.611121:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 188 00000100:00100000:3.0:1788940799.616019:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940799.616265:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036062848 00000100:00100000:2.0:1788940799.616287:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036062848 00000100:00100000:3.0:1788940799.616549:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 189 00000100:00100000:3.0:1788940799.616572:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:11539:x1875840036062848:12345-192.168.202.17@tcp:54:lfs.0 00010000:00010000:3.0:1788940799.616675:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa3961 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.616697:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa3961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.616712:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa3961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.616913:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa3961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.616923:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa3961 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.616931:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa3961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.616939:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41421c2800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940799.616945:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa3961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.616954:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa3961 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.616970:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7c00) 00010000:00010000:3.0:1788940799.616973:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940799.616980:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa3961 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.617002:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41421c2800/0xa1d8aa9164aa3961 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940799.617102:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:11539:x1875840036062848:12345-192.168.202.17@tcp:54:lfs.0 Request processed in 537us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940799.617111:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 189 00000100:00100000:3.0:1788940799.619367:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940799.619443:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036063104 00000100:00100000:2.0:1788940799.619688:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036063104 00000100:00100000:2.0:1788940799.619963:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 51 00000100:00100000:2.0:1788940799.619975:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:11539:x1875840036063104:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:2.0:1788940799.620273:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:11539:x1875840036063104:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 300us (917us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788940799.620282:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 51 00000100:00100000:3.0:1788940799.671437:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940799.671772:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036063360 00000100:00100000:0.0:1788940799.671789:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036063360 00000100:00100000:0.0:1788940799.671896:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 190 00000100:00100000:0.0:1788940799.671908:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:11064:x1875840036063360:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:0.0:1788940799.671941:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940799.671969:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa3968 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2266d7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.672812:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.672899:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3953 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d0 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.672911:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.672950:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d0 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.672965:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3953 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d0 expref: 28 pid: 5833 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940799.672980:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134c57480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068567296:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940799.673679:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a068780 going to sleep for 11 seconds 00000100:00100000:3.0:1788940799.682517:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940799.682640:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036063488 00000100:00100000:1.0:1788940799.682653:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036063488 00010000:00010000:1.0:1788940799.682726:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3953 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d0 expref: 29 pid: 5833 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940799.682784:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 73 00000100:00100000:1.0:1788940799.682796:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+29:2359:x1875840036063488:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940799.682817:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940799.682826:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3953 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d0 expref: 29 pid: 5833 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.682843:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3953 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d0 expref: 29 pid: 5833 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.682887:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7c00) 00010000:00010000:1.0:1788940799.682894:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.682906:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.682915:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.682940:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940799.683016:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+29:2359:x1875840036063488:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 222us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940799.683025:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 73 00010000:00010000:0.0:1788940799.683374:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3953 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d0 expref: 28 pid: 5833 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940799.683404:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134c57480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068567296:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940799.683434:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.683463:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.683470:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940799.683509:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788940799.683674:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa3968 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d7 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.683692:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d7 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.683713:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7c00) 00010000:00010000:0.0:1788940799.683717:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788940799.683721:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4136235a00, rc 0) 00000100:00100000:0.0:1788940799.683795:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:11064:x1875840036063360:12345-192.168.202.17@tcp:101:bash.0 Request processed in 11889us (12383us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788940799.683804:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 190 00000100:00100000:3.0:1788940799.686604:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940799.686796:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036063744 00000100:00100000:2.0:1788940799.686810:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036063744 00000100:00100000:2.0:1788940799.686919:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 191 00000100:00100000:2.0:1788940799.686932:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:11064:x1875840036063744:12345-192.168.202.17@tcp:36:bash.0 00010000:00010000:2.0:1788940799.687366:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa397d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.687393:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa397d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.687407:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa397d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940799.687477:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788940799.687509:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f6e744f reply state 00000000ece750f6 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa397d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940799.687520:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788940799.687573:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788940799.687720:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:11064:x1875840036063744:12345-192.168.202.17@tcp:36:bash.0 Request processed in 789us (1131us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788940799.687729:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 191 00000020:00080000:2.0:1788940799.687736:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788940799.690223:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa397d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.690246:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa397d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.690256:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa397d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.690263:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940799.690268:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa397d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.690278:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa397d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.690325:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7c00) 00010000:00010000:1.0:1788940799.690328:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940799.690335:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa397d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.690342:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa397d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940799.691353:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940799.691587:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036063872 00000100:00100000:2.0:1788940799.691600:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036063872 00000100:00100000:2.0:1788940799.691683:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 192 00000100:00100000:2.0:1788940799.691697:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+31:11064:x1875840036063872:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:2.0:1788940799.691730:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940799.691765:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3984 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2266de expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.691847:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3984 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266de expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.691880:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3984 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266de expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.691905:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7c00) 00010000:00010000:2.0:1788940799.691909:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940799.691912:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6e00, rc 0) 00000100:00100000:2.0:1788940799.691989:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:11064:x1875840036063872:12345-192.168.202.17@tcp:101:bash.0 Request processed in 295us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940799.691997:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 192 00000100:00100000:2.0:1788940799.699739:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940799.702149:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036064000 00000100:00100000:3.0:1788940799.702174:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036064000 00000100:00100000:2.0:1788940799.702486:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 58 00000100:00100000:2.0:1788940799.702514:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:11064:x1875840036064000:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:2.0:1788940799.702538:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940799.702567:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc9c6740/0xa1d8aa9164aa398b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2266e5 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940799.702606:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa111fb, atime: 0x6aa111f9, ctime: 0x6aa111fb, blocks: 0xb 00010000:00010000:2.0:1788940799.702641:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788940799.702647:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940799.702658:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9c6740/0xa1d8aa9164aa398b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266e5 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.702681:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc9c6740/0xa1d8aa9164aa398b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266e5 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.702720:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6a00, rc 0) 00000100:00100000:2.0:1788940799.702923:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:11064:x1875840036064000:12345-192.168.202.17@tcp:101:bash.0 Request processed in 426us (3200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940799.702931:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 58 00000100:00080000:3.0:1788940799.704865:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940799.709103:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940799.709663:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036064128 00000100:00100000:3.0:1788940799.709678:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036064128 00002000:00010000:2.0:1788940799.712127:0:6677:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788940799.712151:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f413a697800 with x1875840036064128 ext(0->18446744073709551615) 00002000:00010000:2.0:1788940799.712169:0:6677:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f413a697800. 00000100:00100000:2.0:1788940799.712306:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:2.0:1788940799.712321:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2359:x1875840036064128:12345-192.168.202.17@tcp:10:bash.0 00002000:00010000:2.0:1788940799.713377:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788940799.713386:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788940795 -> 1788940798 00002000:00010000:2.0:1788940799.713389:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788940793 -> 1788940793 00002000:00010000:2.0:1788940799.713392:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788940795 -> 1788940798 00002000:00010000:2.0:1788940799.713394:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788940799.713504:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2359:x1875840036064128:12345-192.168.202.17@tcp:10:bash.0 Request processed in 1183us (4414us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788940799.713515:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 5 00002000:00010000:2.0:1788940799.713521:0:6677:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788940799.713525:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f413a697800 with x1875840036064128 ext(0->18446744073709551615) 00002000:00010000:2.0:1788940799.713531:0:6677:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f413a697800. 00000100:00100000:1.0:1788940799.801348:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940799.803372:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036064256 00000100:00100000:3.0:1788940799.803396:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036064256 00000100:00100000:3.0:1788940799.803668:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 193 00000100:00100000:3.0:1788940799.803685:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:11553:x1875840036064256:12345-192.168.202.17@tcp:34:lfs.0 00010000:00010000:3.0:1788940799.803800:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3992 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.803825:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3992 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.803841:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3992 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.803894:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.803902:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.803910:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804265:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804277:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804285:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940799.804343:0:7198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804356:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3992 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804364:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3992 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804371:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3992 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804378:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f42800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940799.804383:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3992 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804397:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3992 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804411:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:3.0:1788940799.804415:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940799.804433:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3992 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804440:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3992 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804456:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804462:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3999 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804468:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804474:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f43c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940799.804477:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.804484:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3999 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.805004:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4112cbf600) 00010000:00010000:3.0:1788940799.805012:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940799.805018:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3999 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.805038:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3999 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.805061:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.805067:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.805072:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.805077:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f42000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940799.805080:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.805086:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.805096:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7c00) 00010000:00010000:3.0:1788940799.805098:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940799.805101:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.805107:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940799.805376:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:11553:x1875840036064256:12345-192.168.202.17@tcp:34:lfs.0 Request processed in 1689us (4038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940799.805387:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 193 00000100:00100000:3.0:1788940799.841686:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940799.841774:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036064512 00000100:00100000:0.0:1788940799.841789:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036064512 00000100:00100000:0.0:1788940799.842094:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 194 00000100:00100000:0.0:1788940799.842365:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+32:11556:x1875840036064512:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940799.842396:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940799.842425:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa39a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2266ec expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.842567:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa39ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.842585:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa39ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.842599:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa39ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.842618:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa39b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.842626:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa39b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.842634:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa39b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.843009:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa39bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.843031:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa39bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.843039:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa39bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940799.843053:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788940799.844393:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa39ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844407:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa39ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844412:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa39ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844416:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940799.844421:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa39ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844430:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa39ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844449:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:1.0:1788940799.844453:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940799.844459:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa39ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844466:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234c00/0xa1d8aa9164aa39ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844503:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa39b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844510:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa39b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844515:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa39b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844520:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940799.844523:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa39b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844530:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa39b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844549:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f410ad9f300) 00010000:00010000:1.0:1788940799.844552:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940799.844556:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa39b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844561:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235c00/0xa1d8aa9164aa39b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844625:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234000/0xa1d8aa9164aa39a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266ec expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844643:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa39bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266ec expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940799.844663:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7c00) 00010000:00010000:1.0:1788940799.844666:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788940799.844669:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36600, rc 0) 00000100:00100000:1.0:1788940799.844765:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+34:11556:x1875840036064512:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 2408us (3090us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788940799.844774:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 194 00000100:00100000:0.0:1788940799.850359:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940799.851019:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036064640 00000100:00100000:3.0:1788940799.851035:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036064640 00000100:00100000:3.0:1788940799.851219:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 195 00000100:00100000:3.0:1788940799.851235:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+34:11556:x1875840036064640:12345-192.168.202.17@tcp:54:lfs.0 00010000:00010000:3.0:1788940799.851340:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.851363:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d7 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.851375:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.851421:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d7 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.851446:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d7 expref: 34 pid: 5835 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940799.851465:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a5b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875840068567424:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940799.851586:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4103511c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940799.855231:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a5b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875840068567424:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940799.855286:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940799.857761:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940799.857950:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036064896 00000100:00100000:3.0:1788940799.857964:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036064896 00000100:00100000:2.0:1788940799.858171:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 52 00000100:00100000:2.0:1788940799.858754:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:5603:x1875840036064896:12345-192.168.202.17@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788940799.859900:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+36:5603:x1875840036064896:12345-192.168.202.17@tcp:35:ldlm_bl.0 Request processed in 1702us (2144us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788940799.859915:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 52 00000100:00100000:0.0:1788940799.861899:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940799.861978:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036065024 00000100:00100000:3.0:1788940799.861989:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036065024 00010000:00010000:3.0:1788940799.862045:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d7 expref: 36 pid: 5835 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940799.862090:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 74 00000100:00100000:3.0:1788940799.862102:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+36:2358:x1875840036065024:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940799.862121:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940799.862129:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d7 expref: 36 pid: 5835 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.862154:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d7 expref: 36 pid: 5835 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.862219:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235a00/0xa1d8aa9164aa396f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266d7 expref: 36 pid: 5835 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.862236:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7c00) 00010000:00010000:3.0:1788940799.862241:0:7622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.862259:0:7622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.862268:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940799.862308:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940799.862358:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:2358:x1875840036065024:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 260us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940799.862381:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 74 00010000:00010000:2.0:1788940799.862639:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.862646:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.862679:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.862684:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.862689:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.862693:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f42000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940799.862697:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.862703:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.862709:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7c00) 00010000:00010000:2.0:1788940799.862711:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940799.862714:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.862726:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42000/0xa1d8aa9164aa39ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940799.862766:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+34:11556:x1875840036064640:12345-192.168.202.17@tcp:54:lfs.0 Request processed in 11536us (12424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940799.862775:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 195 00000100:00100000:1.0:1788940799.865526:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940799.865796:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036065280 00000100:00100000:3.0:1788940799.865812:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036065280 00000100:00100000:3.0:1788940799.865897:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 53 00000100:00100000:3.0:1788940799.865910:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+34:11556:x1875840036065280:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:3.0:1788940799.866589:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:11556:x1875840036065280:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 679us (1073us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788940799.866599:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 53 00000100:00100000:1.0:1788940799.957752:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940799.957879:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036065536 00000100:00100000:2.0:1788940799.957895:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036065536 00000100:00100000:2.0:1788940799.957972:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 196 00000100:00100000:2.0:1788940799.957985:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+35:11567:x1875840036065536:12345-192.168.202.17@tcp:101:cat.0 00010000:00010000:2.0:1788940799.958018:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940799.958043:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa39d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2266f3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.958149:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa39d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.958170:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa39d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.958233:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa39d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.958254:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa39df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.958263:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa39df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.958295:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa39df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.958784:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa39e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.958795:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa39e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.958803:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa39e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940799.958817:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788940799.958945:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa39d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.958954:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa39d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.958961:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa39d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.958967:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940799.958972:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa39d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.958981:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa39d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.958997:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:2.0:1788940799.959001:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940799.959012:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa39d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.959018:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa39d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.959034:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa39df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.959040:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa39df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.959045:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa39df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.959050:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940799.959053:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa39df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.959058:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa39df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.959064:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f41054d7000) 00010000:00010000:2.0:1788940799.959066:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940799.959068:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa39df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.959074:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa39df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.959130:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa39d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266f3 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.959171:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa39e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266f3 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940799.959179:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7c00) 00010000:00010000:2.0:1788940799.959182:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788940799.959184:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6600, rc 0) 00000100:00100000:2.0:1788940799.963568:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+37:11567:x1875840036065536:12345-192.168.202.17@tcp:101:cat.0 Request processed in 5574us (5820us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788940799.963583:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 196 00000100:00100000:0.0:1788940799.972938:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940799.973152:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036065792 00000100:00100000:2.0:1788940799.973168:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036065792 00000100:00100000:2.0:1788940799.973285:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 54 00000100:00100000:2.0:1788940799.973298:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+37:11567:x1875840036065792:12345-192.168.202.17@tcp:35:cat.0 00000100:00100000:2.0:1788940799.974470:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+38:11567:x1875840036065792:12345-192.168.202.17@tcp:35:cat.0 Request processed in 1165us (1540us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788940799.974484:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 54 00000100:00100000:1.0:1788940799.999471:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940799.999629:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036066048 00000100:00100000:0.0:1788940799.999643:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036066048 00000100:00100000:0.0:1788940799.999716:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 197 00000100:00100000:0.0:1788940799.999728:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+38:11568:x1875840036066048:12345-192.168.202.17@tcp:36:rm.0 00010000:00010000:0.0:1788940799.999805:0:7198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788940799.999950:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa39e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266f3 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.999982:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36600/0xa1d8aa9164aa39bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266ec expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940799.999997:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3984 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266de expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.000019:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f41054d7c00) 00010000:00010000:0.0:1788940800.000034:0:7198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940800.000061:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa39f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.000079:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa39f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.000091:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa39f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.000110:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa39fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.000117:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa39fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.000157:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa39fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.000964:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a02 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.000978:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.000987:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940800.002862:0:7198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788940800.002875:0:7198:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 441306686381ns, next at 442306683853ns, rc = 0 00010000:00010000:0.0:1788940800.002953:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3a09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.002969:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.002978:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.002986:0:7198:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3a09 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.002991:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3a09 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.003006:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3a09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.003053:0:7198:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940800.003089:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.003096:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a02 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.003104:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a02 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.003105:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940800.003115:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940800.003118:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3a09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.003121:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a02 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.003136:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940800.003148:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a02 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.003153:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3a09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.003164:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3a09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.003166:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f410ad9f400) 00010000:00010000:0.0:1788940800.003175:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788940800.003182:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a02 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.003218:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8f410ad9f400) 00010000:00010000:0.0:1788940800.003221:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a02 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.003223:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788940800.003229:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3a09 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.003235:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3a09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.003251:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa39f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.003252:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940800.003255:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940800.003262:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa39f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.003269:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940800.003272:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa39f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.003288:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940800.003292:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa39f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.003298:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa39f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.003309:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:0.0:1788940800.003314:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940800.003318:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa39f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.003324:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa39f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940800.003341:0:7198:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6b3fb79 reply state 000000007ad5c7ee transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa39fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940800.003353:0:7198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940800.003501:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+37:11568:x1875840036066048:12345-192.168.202.17@tcp:36:rm.0 Request processed in 3769us (4040us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788940800.003514:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 197 00010000:00010000:2.0:1788940800.005489:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa39fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.005521:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa39fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.005530:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa39fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.005537:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940800.005556:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa39fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.005565:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa39fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.005585:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f410ad9f700) 00010000:00010000:2.0:1788940800.005589:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940800.005594:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa39fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.005601:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa39fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940800.010438:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068567552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940800.010958:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940800.012080:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068567552 00000100:00100000:0.0:1788940800.012094:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068567552 00000100:00100000:0.0:1788940800.012230:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788940800.012243:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875840068567552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940800.012294:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940800.012388:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875840068567552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940800.012417:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788940800.012541:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134c56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068567552:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788940800.012757:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940800.052458:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940800.052659:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036066304 00000100:00100000:3.0:1788940800.052673:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036066304 00000100:00100000:3.0:1788940800.052742:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 198 00000100:00100000:3.0:1788940800.052752:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+36:11574:x1875840036066304:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:3.0:1788940800.052780:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940800.052802:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3a10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2266fa expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.052940:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3a17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.052954:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3a17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.052965:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3a17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.052976:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42c00/0xa1d8aa9164aa3a1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.052980:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42c00/0xa1d8aa9164aa3a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.052985:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42c00/0xa1d8aa9164aa3a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788940800.053674:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788940800.053892:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.053913:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.053922:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.053970:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3a17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.053978:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3a17 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.053986:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3a17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.053994:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f42800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940800.053999:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3a17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.054007:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3a17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.054020:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:3.0:1788940800.054023:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940800.054029:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3a17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.054035:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3a17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788940800.054051:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c36f63c3 reply state 00000000be614fab transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42c00/0xa1d8aa9164aa3a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940800.054068:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788940800.054105:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3a10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266fa expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.054121:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266fa expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.054128:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbf300) 00010000:00010000:3.0:1788940800.054130:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940800.054133:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4140f42200, rc 0) 00000100:00100000:3.0:1788940800.054299:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+39:11574:x1875840036066304:12345-192.168.202.17@tcp:101:bash.0 Request processed in 1546us (1854us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788940800.054308:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 198 00010000:00010000:2.0:1788940800.059912:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42c00/0xa1d8aa9164aa3a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.059931:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42c00/0xa1d8aa9164aa3a1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.059938:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42c00/0xa1d8aa9164aa3a1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.059943:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f42c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940800.059948:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42c00/0xa1d8aa9164aa3a1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.059956:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42c00/0xa1d8aa9164aa3a1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.059979:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4112cbf800) 00010000:00010000:2.0:1788940800.060008:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940800.060028:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42c00/0xa1d8aa9164aa3a1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.060035:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42c00/0xa1d8aa9164aa3a1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940800.063104:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940800.063620:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036066432 00000100:00100000:2.0:1788940800.063635:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036066432 00000100:00100000:2.0:1788940800.063724:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 59 00000100:00100000:2.0:1788940800.063738:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41086cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2359:x1875840036066432:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:2.0:1788940800.063762:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940800.063792:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3a33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226701 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940800.063826:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940800.063852:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788940800.063857:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940800.063868:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3a33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226701 expref: 6 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.063890:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3a33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226701 expref: 6 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.063904:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7200, rc 0) 00000100:00100000:2.0:1788940800.063982:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41086cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840036066432:12345-192.168.202.17@tcp:101:bash.0 Request processed in 247us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940800.063990:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 59 00000100:00080000:0.0:1788940800.064859:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940800.068813:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940800.069178:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036066560 00000100:00100000:2.0:1788940800.069235:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036066560 00000100:00100000:2.0:1788940800.069303:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 60 00000100:00100000:2.0:1788940800.069314:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:11574:x1875840036066560:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:2.0:1788940800.069339:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940800.069366:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226708 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.069410:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3a33 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226701 expref: 7 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.069422:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940800.069437:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940800.069444:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.069501:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3a33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226701 expref: 7 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.069517:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3a33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226701 expref: 7 pid: 6674 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940800.069531:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a697b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8426:1875840068567680:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940800.069652:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4142151f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940800.072264:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940800.072403:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036066688 00000100:00100000:1.0:1788940800.072418:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036066688 00000100:00100000:2.0:1788940800.072470:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a697b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8426:1875840068567680:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940800.072476:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3a33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226701 expref: 8 pid: 6674 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.072517:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940800.072529:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 75 00010000:00010000:2.0:1788940800.072560:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7000, rc 0) 00000100:00100000:2.0:1788940800.072637:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:11574:x1875840036066560:12345-192.168.202.17@tcp:101:bash.0 Request processed in 3324us (3838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940800.072659:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41080e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2359:x1875840036066688:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940800.072681:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940800.072710:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3a33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226701 expref: 8 pid: 6674 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.072736:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3a33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226701 expref: 8 pid: 6674 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.072765:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3a33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226701 expref: 8 pid: 6674 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.072783:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940800.072788:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940800.072798:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.072809:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.072853:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940800.072870:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f400261c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1875840068567808:192.168.202.17@tcp:105: 00000100:00100000:2.0:1788940800.072921:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 60 00000100:00100000:1.0:1788940800.072940:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41244b1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788940800.077176:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f400261c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5817:1875840068567808:192.168.202.17@tcp:105: 00010000:00010000:1.0:1788940800.077238:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940800.077329:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41080e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2359:x1875840036066688:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 4671us (5079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940800.077342:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 75 00000100:00100000:3.0:1788940800.079386:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940800.079594:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036066944 00000100:00100000:2.0:1788940800.079607:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036066944 00000100:00100000:2.0:1788940800.079682:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 55 00000100:00100000:2.0:1788940800.079695:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+38:11574:x1875840036066944:12345-192.168.202.17@tcp:35:bash.0 00000100:00100000:2.0:1788940800.080164:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+39:11574:x1875840036066944:12345-192.168.202.17@tcp:35:bash.0 Request processed in 470us (785us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788940800.080173:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 55 00000100:00100000:3.0:1788940800.178652:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940800.178723:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940800.178774:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036067072 00000100:00100000:1.0:1788940800.178791:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036067072 00000100:00100000:1.0:1788940800.178871:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 305 00000100:00100000:1.0:1788940800.178883:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411125d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:2359:x1875840036067072:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940800.178903:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036067200 00000100:00100000:2.0:1788940800.178909:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036067200 00000100:00100000:2.0:1788940800.178974:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 173 00000100:00100000:2.0:1788940800.178983:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840036067200:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940800.178983:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411125d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+13:2359:x1875840036067072:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 103us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940800.178991:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 305 00000100:00100000:2.0:1788940800.179018:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2359:x1875840036067200:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 38us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940800.179025:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 173 00000100:00080000:0.0:1788940800.179729:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940800.206802:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940800.207437:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036067328 00000100:00100000:1.0:1788940800.207453:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036067328 00000100:00100000:1.0:1788940800.207539:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 199 00000100:00100000:1.0:1788940800.207552:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+39:11590:x1875840036067328:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:1.0:1788940800.207588:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940800.207617:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3a41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22670f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.207697:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3a48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.207711:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.207721:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940800.207757:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788940800.207760:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940800.207778:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.207800:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3a41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22670f expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.207835:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22670f expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.208471:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:1.0:1788940800.208475:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940800.208480:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5800, rc 0) 00000100:00100000:1.0:1788940800.208585:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+40:11590:x1875840036067328:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 1034us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940800.208594:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 199 00000100:00100000:2.0:1788940800.216094:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940800.216242:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036067584 00000100:00100000:3.0:1788940800.216257:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036067584 00000100:00100000:3.0:1788940800.216339:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 200 00000100:00100000:3.0:1788940800.216352:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+40:11590:x1875840036067584:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:3.0:1788940800.216386:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940800.216414:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3a4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226716 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.216606:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3a56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.216626:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.216642:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940800.216657:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788940800.216812:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3a4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226716 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.216834:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3a56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226716 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.216844:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbf300) 00010000:00010000:3.0:1788940800.216847:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940800.216852:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4140f43c00, rc 0) 00000100:00100000:3.0:1788940800.216924:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+42:11590:x1875840036067584:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 575us (852us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788940800.216932:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 200 00000100:00100000:3.0:1788940800.226555:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940800.226776:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036067712 00000100:00100000:0.0:1788940800.226791:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036067712 00000100:00100000:0.0:1788940800.226884:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 15 00000100:00100000:0.0:1788940800.226897:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+42:2359:x1875840036067712:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940800.226918:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940800.226952:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43c00/0xa1d8aa9164aa3a56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226716 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.226975:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbf300) 00010000:00010000:0.0:1788940800.226981:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940800.227057:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+41:2359:x1875840036067712:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 162us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940800.227065:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 15 00000100:00100000:1.0:1788940800.229368:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940800.229803:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036067968 00000100:00100000:2.0:1788940800.229817:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036067968 00000100:00100000:2.0:1788940800.229896:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 201 00000100:00100000:2.0:1788940800.229907:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+41:11590:x1875840036067968:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940800.229940:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940800.229985:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3a64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22671d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.230438:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3a6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.230458:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3a6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.230473:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3a6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940800.230490:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788940800.231065:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3a64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22671d expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.231086:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3a6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22671d expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.238248:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbf300) 00010000:00010000:2.0:1788940800.238262:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788940800.238269:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7200, rc 0) 00000100:00100000:2.0:1788940800.238402:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+43:11590:x1875840036067968:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 8488us (9039us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788940800.238415:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 201 00000100:00100000:3.0:1788940800.244101:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940800.244258:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036068096 00000100:00100000:2.0:1788940800.244273:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036068096 00000100:00100000:2.0:1788940800.244346:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 61 00000100:00100000:2.0:1788940800.244359:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+6:2358:x1875840036068096:12345-192.168.202.17@tcp:1:lfs.0 00010000:00010000:2.0:1788940800.244467:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3a79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.244502:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.244512:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940800.244518:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940800.244524:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3a79 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.244570:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 6 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.244587:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 6 pid: 8426 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940800.244606:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a694e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6674:1875840068567936:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940800.244730:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4142151600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940800.247259:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a694e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6674:1875840068567936:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940800.247298:0:6674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3a79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940800.247772:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940800.248271:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036068224 00000100:00100000:1.0:1788940800.248282:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036068224 00002000:00100000:1.0:1788940800.248347:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8f413a66f100 x1875840036068224/t0(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:21/0 lens 504/0 e 0 to 0 dl 1788940811 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940800.248360:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f413a66f100 with x1875840036068224 ext(0->8) 00010000:00010000:1.0:1788940800.248370:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 7 pid: 8426 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.248388:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 7 pid: 8426 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940800.248396:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f413a66f100 00000100:00100000:1.0:1788940800.248437:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 3 00000100:00100000:1.0:1788940800.248448:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2358:x1875840036068224:12345-192.168.202.17@tcp:4:lfs.0 00000100:00100000:1.0:1788940800.250776:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2358:x1875840036068224:12345-192.168.202.17@tcp:4:lfs.0 Request processed in 641us (1321us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788940800.250827:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 3 00002000:00100000:1.0:1788940800.250847:0:6678:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8f413a66f100 x1875840036068224/t4294967308(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:21/0 lens 504/448 e 0 to 0 dl 1788940811 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940800.250859:0:6678:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f413a66f100 with x1875840036068224 ext(0->8) 00010000:00010000:1.0:1788940800.250871:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 9 pid: 8426 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.250895:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 9 pid: 8426 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940800.250903:0:6678:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8f413a66f100 00000100:00100000:3.0:1788940800.252167:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940800.252795:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036068352 00000100:00100000:0.0:1788940800.252808:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036068352 00010000:00010000:0.0:1788940800.252875:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 9 pid: 8426 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940800.252928:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 76 00000100:00100000:0.0:1788940800.252940:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2359:x1875840036068352:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940800.252959:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788940800.252983:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788940800.252986:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788940799 00002000:00010000:0.0:1788940800.253003:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788940799 00002000:00010000:0.0:1788940800.253006:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788940799 00010000:00010000:0.0:1788940800.253014:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 9 pid: 8426 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.253030:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 9 pid: 8426 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.253058:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3a3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226708 expref: 9 pid: 8426 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.253078:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940800.253084:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940800.253090:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.253102:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3a79 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.253147:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940800.253181:0:6674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.253230:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.253265:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940800.253267:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2359:x1875840036068352:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 328us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940800.253284:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 76 00010000:00010000:2.0:1788940800.253285:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.253297:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.253306:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940800.253312:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.253323:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3a79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.253337:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3a79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.253346:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3a79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940800.253415:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2358:x1875840036068096:12345-192.168.202.17@tcp:1:lfs.0 Request processed in 9059us (9330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940800.253438:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 61 00000100:00100000:1.0:1788940800.263564:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940800.263734:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036068608 00000100:00100000:0.0:1788940800.263749:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036068608 00000100:00100000:0.0:1788940800.263850:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 56 00000100:00100000:0.0:1788940800.263863:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41057c6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+43:11590:x1875840036068608:12345-192.168.202.17@tcp:35:lfs.0 00000004:00010000:0.0:1788940800.263974:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3a6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22671d expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940800.264435:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788940800.264482:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788940800.265438:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788940800.265518:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.265541:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266fa expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.265553:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.265597:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266fa expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.265615:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266fa expref: 47 pid: 5835 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940800.265633:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134c57b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1875840068568064:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940800.266627:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a068780 going to sleep for 11 seconds 00000100:00100000:0.0:1788940800.273797:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134c57b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1875840068568064:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940800.273837:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940800.274592:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940800.278345:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036068736 00000100:00100000:3.0:1788940800.278389:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036068736 00010000:00010000:3.0:1788940800.278452:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266fa expref: 48 pid: 5835 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940800.278522:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 77 00000100:00100000:3.0:1788940800.278534:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+48:2358:x1875840036068736:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940800.278554:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940800.278562:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266fa expref: 48 pid: 5835 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.278578:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266fa expref: 48 pid: 5835 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.278618:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266fa expref: 48 pid: 5835 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.278640:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbf300) 00010000:00010000:3.0:1788940800.278647:0:7622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.278657:0:7622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.278666:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.278704:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940800.278798:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+47:2358:x1875840036068736:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 265us (4210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940800.278817:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 77 00010000:00010000:0.0:1788940800.279534:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.279557:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788940800.279765:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788940800.282214:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788940800.282437:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134c57b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875840068568192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788940800.282520:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940800.282561:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a0680c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940800.282595:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068568192 00000100:00100000:2.0:1788940800.282604:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068568192 00000100:00100000:2.0:1788940800.282677:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940800.282688:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875840068568192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788940800.282784:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875840068568192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 97us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940800.282793:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788940800.283266:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134c57b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875840068568192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788940800.283767:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788940800.283833:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4101218a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875840068568320:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788940800.283888:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940800.283916:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410ac0a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940800.283947:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068568320 00000100:00100000:2.0:1788940800.283954:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068568320 00000100:00100000:2.0:1788940800.284045:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788940800.284054:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875840068568320:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788940800.284319:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1875840068568320:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 266us (428us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788940800.284327:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788940800.285491:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940800.285656:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4101218a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875840068568320:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788940800.285817:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1788940800.285899:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.285912:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.285920:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.285951:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940800.285957:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.285967:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.285987:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbf300) 00010000:00010000:2.0:1788940800.285990:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788940800.285997:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.286004:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030a00/0xa1d8aa9164aa3a80 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788940800.286798:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788940800.286933:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788940800.286951:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441590762193ns, next at 442590759205ns, rc = 0 00000001:00080000:2.0:1788940800.286959:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788940800.287014:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbf300) 00010000:00010000:2.0:1788940800.287018:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788940800.287028:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3a6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22671d expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940800.289104:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41057c6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+50:11590:x1875840036068608:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 25217us (25528us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788940800.289123:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 56 00000020:00080000:2.0:1788940800.289131:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788940800.311789:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940800.311994:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036068864 00000100:00100000:3.0:1788940800.312010:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036068864 00000100:00100000:3.0:1788940800.312114:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 202 00000100:00100000:3.0:1788940800.312128:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+50:11590:x1875840036068864:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:3.0:1788940800.312171:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940800.312422:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226724 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.312508:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226724 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.312526:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226724 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.312550:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:3.0:1788940800.312554:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940800.312558:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4140f42200, rc 0) 00000100:00100000:3.0:1788940800.312634:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+51:11590:x1875840036068864:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 510us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940800.312666:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 202 00000100:00100000:3.0:1788940800.315773:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940800.319783:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036069120 00000100:00100000:2.0:1788940800.319805:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036069120 00000100:00100000:2.0:1788940800.319956:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 57 00000100:00100000:2.0:1788940800.319970:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+51:11590:x1875840036069120:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:2.0:1788940800.321904:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+52:11590:x1875840036069120:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 1923us (6131us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788940800.321920:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 57 00000040:00080000:3.0:1788940800.456621:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940800.456637:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940800.456874:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788940800.456882:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788940800.468119:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940800.468387:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036069248 00000100:00100000:1.0:1788940800.468404:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036069248 00000100:00100000:1.0:1788940800.468491:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 203 00000100:00100000:1.0:1788940800.468505:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+52:11600:x1875840036069248:12345-192.168.202.17@tcp:34:lfs.0 00010000:00010000:1.0:1788940800.468616:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3a8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468638:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3a8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468652:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3a8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468686:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3a95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468691:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468696:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468797:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3a9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468802:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468806:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940800.468853:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468870:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3a8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468877:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3a8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468885:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3a8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468893:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940800.468898:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3a8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468912:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3a8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468925:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:1.0:1788940800.468927:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940800.468932:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3a8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468937:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3a8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468949:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468952:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3a95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468956:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3a95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468959:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940800.468961:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3a95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468965:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3a95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468968:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f41129a4200) 00010000:00010000:1.0:1788940800.468969:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940800.468971:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3a95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468982:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3a95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468994:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.468997:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3a9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.469002:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3a9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.469005:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940800.469007:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3a9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.469010:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3a9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.469013:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:1.0:1788940800.469015:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940800.469016:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3a9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.469019:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3a9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940800.469523:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+52:11600:x1875840036069248:12345-192.168.202.17@tcp:34:lfs.0 Request processed in 1016us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940800.469532:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 203 00000100:00100000:1.0:1788940800.512309:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940800.512628:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036069504 00000100:00100000:3.0:1788940800.512646:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036069504 00000100:00100000:3.0:1788940800.512732:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 204 00000100:00100000:3.0:1788940800.512741:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+52:11603:x1875840036069504:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:3.0:1788940800.512765:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940800.512790:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3aa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22672b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.512876:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3aaa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.512896:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3aaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.512912:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3aaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.512931:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3ab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.512938:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.512945:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513153:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42e00/0xa1d8aa9164aa3ab8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513161:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42e00/0xa1d8aa9164aa3ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513168:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42e00/0xa1d8aa9164aa3ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940800.513180:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788940800.513342:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3aaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513352:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3aaa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513359:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3aaa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513365:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f42a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940800.513369:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3aaa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513376:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3aaa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513388:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:3.0:1788940800.513390:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940800.513395:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3aaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513409:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3aaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513423:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513429:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513434:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513439:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f43400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940800.513443:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513449:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513457:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4112cbfd00) 00010000:00010000:3.0:1788940800.513460:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940800.513462:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3ab1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513469:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3ab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513633:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3aa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22672b expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513649:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42e00/0xa1d8aa9164aa3ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22672b expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.513664:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:3.0:1788940800.513667:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940800.513670:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4140f42e00, rc 0) 00000100:00100000:3.0:1788940800.513746:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+54:11603:x1875840036069504:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 1006us (1454us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788940800.513752:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 204 00000100:00100000:3.0:1788940800.517516:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940800.517651:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036069632 00000100:00100000:2.0:1788940800.517669:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036069632 00000100:00100000:2.0:1788940800.517757:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 205 00000100:00100000:2.0:1788940800.517770:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+54:11603:x1875840036069632:12345-192.168.202.17@tcp:54:lfs.0 00010000:00010000:2.0:1788940800.517872:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.517895:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.517910:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.517944:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.517952:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.517958:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.517987:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940800.517992:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.518001:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.518017:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:2.0:1788940800.518020:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788940800.518027:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3ac6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.518033:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940800.518163:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+54:11603:x1875840036069632:12345-192.168.202.17@tcp:54:lfs.0 Request processed in 395us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940800.518173:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 205 00000100:00100000:2.0:1788940800.522982:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940800.523556:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036069888 00000100:00100000:1.0:1788940800.523573:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036069888 00000100:00100000:1.0:1788940800.523651:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 58 00000100:00100000:1.0:1788940800.523666:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+54:11603:x1875840036069888:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:1.0:1788940800.524009:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:11603:x1875840036069888:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 345us (1038us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788940800.524018:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 58 00010000:00010000:2.0:1788940800.584389:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940800.603276:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940800.603361:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036070144 00000100:00100000:2.0:1788940800.603376:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036070144 00000100:00100000:2.0:1788940800.603523:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 206 00000100:00100000:2.0:1788940800.603538:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:11613:x1875840036070144:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:2.0:1788940800.603573:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940800.603578:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788940800.603617:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5800/0xa1d8aa9164aa3a48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22670f expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.603675:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:2.0:1788940800.603682:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940800.603702:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3acd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226732 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.603840:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.603873:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42e00/0xa1d8aa9164aa3ab8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22672b expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.603882:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.603928:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42e00/0xa1d8aa9164aa3ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22672b expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.603944:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42e00/0xa1d8aa9164aa3ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22672b expref: 55 pid: 5834 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940800.603962:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a695c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875840068568448:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940800.604109:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4142151600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940800.615417:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940800.615462:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a695c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875840068568448:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940800.615707:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940800.615755:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036070272 00000100:00100000:1.0:1788940800.615766:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036070272 00010000:00010000:1.0:1788940800.615819:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42e00/0xa1d8aa9164aa3ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22672b expref: 56 pid: 5834 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940800.615980:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 78 00000100:00100000:1.0:1788940800.615993:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+56:2359:x1875840036070272:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940800.616017:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940800.616026:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42e00/0xa1d8aa9164aa3ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22672b expref: 56 pid: 5834 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.616041:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42e00/0xa1d8aa9164aa3ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22672b expref: 56 pid: 5834 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.616069:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42e00/0xa1d8aa9164aa3ab8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22672b expref: 56 pid: 5834 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.616089:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:1.0:1788940800.616095:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.616126:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.616150:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.616182:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940800.616326:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:2359:x1875840036070272:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 335us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940800.616334:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 78 00010000:00010000:2.0:1788940800.616388:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.616402:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940800.616435:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788940800.616648:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3acd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226732 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.616667:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226732 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.616675:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:2.0:1788940800.616678:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788940800.616681:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6600, rc 0) 00000100:00100000:2.0:1788940800.616711:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:11613:x1875840036070144:12345-192.168.202.17@tcp:101:bash.0 Request processed in 13177us (13453us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788940800.616718:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 206 00000100:00100000:3.0:1788940800.626802:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940800.626968:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036070528 00000100:00100000:2.0:1788940800.626980:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036070528 00000100:00100000:2.0:1788940800.627044:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 207 00000100:00100000:2.0:1788940800.627052:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+55:11613:x1875840036070528:12345-192.168.202.17@tcp:36:bash.0 00010000:00010000:2.0:1788940800.627451:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3ae2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.627470:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.627481:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940800.627554:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788940800.627572:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041c45b04 reply state 0000000099fcb0db transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940800.627579:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788940800.627694:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+58:11613:x1875840036070528:12345-192.168.202.17@tcp:36:bash.0 Request processed in 640us (906us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788940800.627702:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 207 00000020:00080000:2.0:1788940800.627708:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788940800.631163:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940800.631324:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036070656 00000100:00100000:1.0:1788940800.631337:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036070656 00000100:00100000:1.0:1788940800.631401:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 208 00000100:00100000:1.0:1788940800.631410:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41129dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+58:11613:x1875840036070656:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:1.0:1788940800.631446:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940800.631470:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3ae9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226739 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.631568:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.631581:0:7198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226732 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.631588:0:7198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3ae2 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.631592:0:7198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.631632:0:7198:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.631665:0:7198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226732 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.631679:0:7198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226732 expref: 59 pid: 5834 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940800.631696:0:7198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f400261d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068568576:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940800.631803:0:7198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110582b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940800.634949:0:7198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f400261d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7198:1875840068568576:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940800.634992:0:7198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940800.636696:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00010000:00010000:0.0:1788940800.636913:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3ae2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.636929:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3ae2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.636937:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3ae2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.636943:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940800.636948:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3ae2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.636957:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3ae2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.636978:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:0.0:1788940800.636982:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940800.636986:0:3288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.637000:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3ae2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.637023:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa3ae2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940800.637182:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036070784 00000100:00100000:2.0:1788940800.637312:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036070784 00010000:00010000:2.0:1788940800.637361:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226732 expref: 59 pid: 5834 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940800.637403:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 79 00000100:00100000:2.0:1788940800.637425:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+59:2358:x1875840036070784:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940800.637447:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940800.637455:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226732 expref: 59 pid: 5834 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.637470:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226732 expref: 59 pid: 5834 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.637503:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6600/0xa1d8aa9164aa3ad4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226732 expref: 59 pid: 5834 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.637514:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:2.0:1788940800.637526:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.637535:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.637543:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940800.637570:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940800.637667:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+58:2358:x1875840036070784:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 253us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940800.637674:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 79 00010000:00010000:1.0:1788940800.638125:0:7198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.638363:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940800.638428:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788940800.638433:0:7198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940800.638461:0:7198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.638517:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3ae9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226739 expref: 58 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.638560:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226739 expref: 57 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.638569:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:1.0:1788940800.638572:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940800.638575:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4400, rc 0) 00000100:00100000:1.0:1788940800.638634:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41129dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+57:11613:x1875840036070656:12345-192.168.202.17@tcp:101:bash.0 Request processed in 7224us (7488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940800.638644:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 208 00000100:00100000:2.0:1788940800.643976:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940800.644086:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036071040 00000100:00100000:1.0:1788940800.644101:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036071040 00000100:00100000:1.0:1788940800.644281:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 59 00000100:00100000:1.0:1788940800.644294:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+57:11613:x1875840036071040:12345-192.168.202.17@tcp:35:bash.0 00000100:00100000:1.0:1788940800.644687:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+58:11613:x1875840036071040:12345-192.168.202.17@tcp:35:bash.0 Request processed in 394us (726us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788940800.644699:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 59 00000100:00100000:2.0:1788940800.715241:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940800.715340:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036071168 00000100:00100000:0.0:1788940800.715354:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036071168 00000100:00100000:0.0:1788940800.715428:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 209 00000100:00100000:0.0:1788940800.715437:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+58:11619:x1875840036071168:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940800.715468:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940800.715643:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031800/0xa1d8aa9164aa3af7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226740 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.715732:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031000/0xa1d8aa9164aa3afe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.715749:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031000/0xa1d8aa9164aa3afe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.715764:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031000/0xa1d8aa9164aa3afe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940800.715808:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788940800.715812:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940800.715832:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031000/0xa1d8aa9164aa3afe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.715873:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031800/0xa1d8aa9164aa3af7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226740 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.715894:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031000/0xa1d8aa9164aa3afe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226740 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.715923:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:0.0:1788940800.715927:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940800.715931:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100031000, rc 0) 00000100:00100000:0.0:1788940800.716001:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+59:11619:x1875840036071168:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 565us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940800.716007:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 209 00000100:00100000:2.0:1788940800.720702:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940800.721088:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036071296 00000100:00100000:3.0:1788940800.721102:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036071296 00000100:00100000:3.0:1788940800.721306:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 210 00000100:00100000:3.0:1788940800.721319:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+59:11619:x1875840036071296:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:3.0:1788940800.721344:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940800.721371:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3b05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226747 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.721465:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.721483:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.721771:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.721807:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.721816:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.721823:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.721958:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43800/0xa1d8aa9164aa3b1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.721969:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43800/0xa1d8aa9164aa3b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.721977:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43800/0xa1d8aa9164aa3b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940800.722023:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788940800.722027:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940800.722048:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43800/0xa1d8aa9164aa3b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722061:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43800/0xa1d8aa9164aa3b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722071:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722078:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722097:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722104:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f43400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940800.722108:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722117:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722141:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:3.0:1788940800.722145:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940800.722151:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722159:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722176:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722182:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722575:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722582:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f42a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940800.722585:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722665:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722676:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f4112cbfd00) 00010000:00010000:3.0:1788940800.722678:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940800.722682:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722688:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722735:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3b05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226747 expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722753:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43800/0xa1d8aa9164aa3b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226747 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940800.722760:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:3.0:1788940800.722762:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940800.722765:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4140f43800, rc 0) 00000100:00100000:3.0:1788940800.723016:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:11619:x1875840036071296:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 1698us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940800.723027:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 210 00000100:00100000:2.0:1788940800.727721:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940800.727910:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036071424 00000100:00100000:0.0:1788940800.727923:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036071424 00000100:00100000:0.0:1788940800.728005:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 16 00000100:00100000:0.0:1788940800.728016:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:2358:x1875840036071424:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940800.728038:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940800.728070:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43800/0xa1d8aa9164aa3b1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226747 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.728092:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:0.0:1788940800.728100:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940800.728243:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+59:2358:x1875840036071424:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 228us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940800.728252:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 16 00000100:00100000:2.0:1788940800.731150:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940800.731709:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036071680 00000100:00100000:1.0:1788940800.731724:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036071680 00000100:00100000:1.0:1788940800.731841:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 211 00000100:00100000:1.0:1788940800.731866:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+59:11619:x1875840036071680:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:1.0:1788940800.731893:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940800.731923:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3b21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22674e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.732057:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.732091:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226739 expref: 60 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.732103:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.732158:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226739 expref: 60 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.732174:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226739 expref: 60 pid: 7198 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940800.732228:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f400261d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068568704:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940800.732350:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110582b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940800.735453:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f400261d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068568704:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940800.735642:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940800.737232:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940800.737514:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036071808 00000100:00100000:0.0:1788940800.737527:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036071808 00010000:00010000:0.0:1788940800.737575:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226739 expref: 61 pid: 7198 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940800.737625:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 80 00000100:00100000:0.0:1788940800.737637:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41080e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+61:2359:x1875840036071808:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940800.737678:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940800.737687:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226739 expref: 61 pid: 7198 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.737702:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226739 expref: 61 pid: 7198 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.737730:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4400/0xa1d8aa9164aa3af0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226739 expref: 61 pid: 7198 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.737751:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:0.0:1788940800.737756:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.737769:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.737779:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.737817:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940800.737899:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41080e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:2359:x1875840036071808:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 264us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940800.737908:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 80 00010000:00010000:1.0:1788940800.738272:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.738282:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940800.738308:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788940800.738515:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3b21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22674e expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.738550:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22674e expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.738558:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:1.0:1788940800.738561:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788940800.738564:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5a00, rc 0) 00000100:00100000:1.0:1788940800.738601:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:11619:x1875840036071680:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 6739us (7477us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788940800.738609:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 211 00000100:00100000:2.0:1788940800.742152:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940800.742331:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036072064 00000100:00100000:0.0:1788940800.742345:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036072064 00000100:00100000:0.0:1788940800.742432:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 17 00000100:00100000:0.0:1788940800.742445:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:11619:x1875840036072064:12345-192.168.202.17@tcp:103:lfs.0 00010000:00010000:0.0:1788940800.742497:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940800.742531:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42200/0xa1d8aa9164aa3a87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226724 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.742554:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:0.0:1788940800.742560:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940800.742631:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+59:11619:x1875840036072064:12345-192.168.202.17@tcp:103:lfs.0 Request processed in 189us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940800.742639:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 17 00000100:00100000:2.0:1788940800.745470:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940800.745633:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036072192 00000100:00100000:1.0:1788940800.745647:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036072192 00000100:00100000:1.0:1788940800.745728:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 212 00000100:00100000:1.0:1788940800.745740:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+59:11619:x1875840036072192:12345-192.168.202.17@tcp:58:lfs.0 00010000:00010000:1.0:1788940800.745886:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3b36 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.745907:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3b36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940800.745921:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3b36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940800.746177:0:7198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788940800.746333:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+59:11619:x1875840036072192:12345-192.168.202.17@tcp:58:lfs.0 Request processed in 593us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940800.746341:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 212 00000100:00100000:2.0:1788940800.749250:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940800.749368:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036072320 00000100:00100000:0.0:1788940800.749382:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036072320 00000100:00100000:0.0:1788940800.749450:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 213 00000100:00100000:0.0:1788940800.749462:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+59:11619:x1875840036072320:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940800.749499:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940800.749527:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031800/0xa1d8aa9164aa3b3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226755 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.749603:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3b36 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.749615:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031800/0xa1d8aa9164aa3b3d lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226755 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.749641:0:5833:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3b36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.749657:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031800/0xa1d8aa9164aa3b3d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226755 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.749700:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:0.0:1788940800.749704:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940800.749709:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031800/0xa1d8aa9164aa3b3d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226755 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940800.749717:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100031800, rc 0) 00000100:00100000:0.0:1788940800.749798:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:11619:x1875840036072320:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 338us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940800.749806:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 213 00000040:00080000:3.0:1788940801.480689:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940801.480706:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940801.480776:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788940801.480785:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788940801.480973:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a047100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875840068568832:192.168.202.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788940801.481153:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410a750cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940801.494899:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940801.495378:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036072448 00000100:00100000:1.0:1788940801.495427:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036072448 00000100:00100000:1.0:1788940801.495598:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 214 00000100:00100000:1.0:1788940801.495611:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+61:11620:x1875840036072448:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788940801.495657:0:7198:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788940801.495801:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+61:11620:x1875840036072448:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 Request processed in 192us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940801.495810:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 214 00000100:00100000:3.0:1788940801.496288:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a047100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875840068568832:192.168.202.17@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1788940801.500095:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940801.502311:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940801.502538:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036072576 00000100:00100000:0.0:1788940801.502551:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036072576 00000100:00100000:0.0:1788940801.502626:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 215 00000100:00100000:0.0:1788940801.502639:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:11620:x1875840036072576:12345-192.168.202.17@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788940801.502743:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3b44 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.502767:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3b44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.502782:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3b44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.502801:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b4b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.502808:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.502836:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.502866:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.502875:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.502883:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940801.502937:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788940801.502942:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940801.502958:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.502970:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3b44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.502977:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3b44 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.502983:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3b44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.502989:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940801.502994:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3b44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503002:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3b44 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503024:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9fd00) 00010000:00010000:0.0:1788940801.503027:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940801.503034:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3b44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503040:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3b44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503055:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503062:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b4b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503067:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503073:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100031400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940801.503076:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503081:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b4b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503089:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8f410ad9f200) 00010000:00010000:0.0:1788940801.503091:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940801.503094:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b4b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503101:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b4b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503141:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503148:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503154:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503160:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100031200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940801.503164:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503170:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503234:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:0.0:1788940801.503237:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940801.503240:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.503247:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.503354:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:11620:x1875840036072576:12345-192.168.202.17@tcp:34:lhsmtool_posix.0 Request processed in 716us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940801.503364:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 215 00000100:00100000:2.0:1788940801.508364:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940801.508510:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036072832 00000100:00100000:1.0:1788940801.508525:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036072832 00000100:00100000:1.0:1788940801.508607:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 216 00000100:00100000:1.0:1788940801.508620:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4141510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+60:11620:x1875840036072832:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940801.508649:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940801.508678:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3b59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22675c expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.508816:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.508835:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.508864:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940801.508881:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788940801.509030:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.509040:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.509069:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.509076:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940801.509082:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.509092:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.509109:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:1.0:1788940801.509112:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788940801.509120:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.509136:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.509240:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3b59 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22675c expref: 62 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.509252:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9fd00) 00010000:00010000:1.0:1788940801.509255:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940801.509260:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3b59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22675c expref: 62 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.509270:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4a00, rc 0) 00000100:00100000:1.0:1788940801.509357:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4141510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+61:11620:x1875840036072832:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 740us (1011us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1788940801.509376:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 216 00000100:00100000:2.0:1788940801.513615:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940801.513765:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036072960 00000100:00100000:0.0:1788940801.513779:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036072960 00000100:00100000:0.0:1788940801.513857:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 217 00000100:00100000:0.0:1788940801.513883:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+61:11620:x1875840036072960:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788940801.513929:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788940801.514063:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+61:11620:x1875840036072960:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 Request processed in 182us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940801.514072:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 217 00000100:00100000:3.0:1788940801.520056:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940801.520706:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036073216 00000100:00100000:1.0:1788940801.520722:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036073216 00000100:00100000:1.0:1788940801.520806:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 218 00000100:00100000:1.0:1788940801.520818:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+61:11620:x1875840036073216:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940801.520843:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940801.520847:0:7198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788940801.520882:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031000/0xa1d8aa9164aa3afe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226740 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.520908:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:1.0:1788940801.520914:0:7198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940801.520932:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3b6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226763 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940801.523738:0:7198:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1788940801.524071:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.526073:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.526799:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.527331:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3b6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226763 expref: 63 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.527400:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226763 expref: 62 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.528979:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f41129a4200) 00010000:00010000:1.0:1788940801.528984:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940801.528992:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5e00, rc 0) 00000100:00100000:1.0:1788940801.530026:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+62:11620:x1875840036073216:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 9196us (9973us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788940801.530042:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 218 00000100:00100000:2.0:1788940801.534597:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940801.535113:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036073472 00000100:00100000:0.0:1788940801.535138:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036073472 00000100:00100000:0.0:1788940801.535270:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 219 00000100:00100000:0.0:1788940801.535283:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+62:11620:x1875840036073472:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788940801.535382:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940801.535599:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5e00/0xa1d8aa9164aa3b75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226763 expref: 62 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.535624:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f41129a4200) 00010000:00010000:0.0:1788940801.535639:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940801.535668:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.535685:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.535698:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539568:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xab662d2e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539593:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xab662d2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539624:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xab662d2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539701:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539709:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b83 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539716:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539723:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100031200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940801.539727:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539735:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539750:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:0.0:1788940801.539753:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940801.539759:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b83 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539765:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3b83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539779:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xab662d2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539785:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xab662d2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539815:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xab662d2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539823:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100031400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940801.539827:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xab662d2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539834:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xab662d2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539846:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xab662d2e (ffff8f410ad9f200) 00010000:00010000:0.0:1788940801.539849:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940801.539852:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xab662d2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.539857:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3b8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xab662d2e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.542845:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+61:11620:x1875840036073472:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 7528us (8229us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940801.542859:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 219 00000100:00100000:2.0:1788940801.546687:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940801.546808:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036073600 00000100:00100000:3.0:1788940801.546822:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036073600 00000100:00100000:3.0:1788940801.546909:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 220 00000100:00100000:3.0:1788940801.546923:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+61:11620:x1875840036073600:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940801.546951:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940801.546981:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3b91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22676a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.547027:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.547044:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.547058:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.547604:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42800/0xa1d8aa9164aa3b91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22676a expref: 63 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.547628:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22676a expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.547639:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4112cbfd00) 00010000:00010000:3.0:1788940801.547642:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788940801.547658:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4140f42a00, rc 0) 00000100:00100000:3.0:1788940801.547785:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+62:11620:x1875840036073600:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 865us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940801.547794:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 220 00000100:00100000:2.0:1788940801.552315:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940801.552767:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036073856 00000100:00100000:3.0:1788940801.552782:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036073856 00000100:00100000:3.0:1788940801.552858:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 221 00000100:00100000:3.0:1788940801.552871:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+62:11620:x1875840036073856:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940801.552983:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.553005:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.553020:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940801.553661:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1788940801.553673:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 442857484810ns, next at 443857482058ns, rc = 0 00000004:00010000:3.0:1788940801.553787:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008ce2822 reply state 000000002d09d258 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940801.553798:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940801.554004:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+64:11620:x1875840036073856:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 1132us (2823us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788940801.554013:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 221 00000100:00100000:2.0:1788940801.557825:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940801.557926:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036073984 00000100:00100000:0.0:1788940801.557940:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036073984 00000100:00100000:0.0:1788940801.558015:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 222 00000100:00100000:0.0:1788940801.558025:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4111298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+64:11620:x1875840036073984:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940801.558058:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940801.558085:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3ba6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226771 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.558242:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226771 expref: 65 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.558261:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226771 expref: 65 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.558287:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4112cbfd00) 00010000:00010000:0.0:1788940801.558290:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940801.558296:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100031400, rc 0) 00000100:00100000:0.0:1788940801.558379:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4111298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+65:11620:x1875840036073984:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 355us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940801.558387:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 222 00000100:00100000:2.0:1788940801.561633:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940801.562181:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036074112 00000100:00100000:0.0:1788940801.562230:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036074112 00000100:00100000:0.0:1788940801.562316:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 62 00000100:00100000:0.0:1788940801.562329:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2358:x1875840036074112:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788940801.563004:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:2358:x1875840036074112:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 Request processed in 674us (1381us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788940801.563015:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 62 00000100:00080000:2.0:1788940801.563136:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940801.567782:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940801.568062:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036074368 00000100:00100000:3.0:1788940801.568079:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036074368 00000100:00100000:3.0:1788940801.568163:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 60 00000100:00100000:3.0:1788940801.568210:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+65:11620:x1875840036074368:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788940801.568609:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+66:11620:x1875840036074368:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 Request processed in 434us (841us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788940801.568618:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 60 00010000:00010000:1.0:1788940801.570988:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.571013:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.571021:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.571028:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f43400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940801.571034:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.571044:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.571066:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4112cbfd00) 00010000:00010000:1.0:1788940801.571070:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788940801.571078:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.571116:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43400/0xa1d8aa9164aa3b9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940801.574023:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940801.574136:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036074624 00000100:00100000:3.0:1788940801.574149:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036074624 00000100:00100000:3.0:1788940801.574263:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 223 00000100:00100000:3.0:1788940801.574276:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+65:11620:x1875840036074624:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788940801.574427:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+65:11620:x1875840036074624:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 154us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940801.574435:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 223 00000100:00100000:2.0:1788940801.577432:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940801.577586:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036074752 00000100:00100000:1.0:1788940801.577599:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036074752 00000100:00100000:1.0:1788940801.577679:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 224 00000100:00100000:1.0:1788940801.577692:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+65:11620:x1875840036074752:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940801.577721:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940801.577750:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3bad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226778 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.577846:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa3bb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.577864:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa3bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.577880:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa3bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940801.577931:0:7198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940801.577955:0:7198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa3bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.577986:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4a00/0xa1d8aa9164aa3bad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226778 expref: 67 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.578008:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa3bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226778 expref: 66 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.578042:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4112cbfd00) 00010000:00010000:1.0:1788940801.578045:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788940801.578050:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5600, rc 0) 00000100:00100000:1.0:1788940801.578137:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+66:11620:x1875840036074752:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 447us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940801.578145:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 224 00000100:00100000:2.0:1788940801.583334:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940801.583448:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036074880 00000100:00100000:1.0:1788940801.583462:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036074880 00000100:00100000:1.0:1788940801.583550:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 63 00000100:00100000:1.0:1788940801.583562:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41115adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+10:2359:x1875840036074880:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940801.583589:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940801.583623:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3bbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22677f expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940801.583662:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa11200, blocks: 0x1 00010000:00010000:1.0:1788940801.583690:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1788940801.583695:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940801.583706:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3bbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22677f expref: 11 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.583729:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3bbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22677f expref: 11 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.583747:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5e00, rc 0) 00000100:00100000:1.0:1788940801.584052:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41115adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+11:2359:x1875840036074880:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 491us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940801.584060:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 63 00000100:00100000:0.0:1788940801.590950:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940801.591051:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036075136 00000100:00100000:3.0:1788940801.591064:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036075136 00000100:00100000:3.0:1788940801.591652:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 225 00000100:00100000:2.0:1788940801.591761:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+66:11620:x1875840036075136:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788940801.591955:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+66:11620:x1875840036075136:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 291us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940801.591965:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 225 00000100:00100000:2.0:1788940801.594947:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940801.595066:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036075264 00000100:00100000:0.0:1788940801.595081:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036075264 00000100:00100000:0.0:1788940801.595160:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 64 00000100:00100000:0.0:1788940801.595172:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+11:11620:x1875840036075264:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940801.595242:0:6671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940801.595287:0:6671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e83ade61/0xa1d8aa9164aa3bc2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226786 expref: -99 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.595336:0:6671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3bbb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22677f expref: 12 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.595348:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940801.595355:0:6671:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940801.595361:0:6671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e83ade61/0xa1d8aa9164aa3bc2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226786 expref: 12 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.595408:0:6671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3bbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22677f expref: 12 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.595440:0:6671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3bbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22677f expref: 12 pid: 6673 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.595458:0:6671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134c57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1875840068568960:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940801.595580:0:6671:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a068000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940801.599995:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940801.600246:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036075392 00000100:00100000:2.0:1788940801.600259:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036075392 00010000:00010000:2.0:1788940801.600315:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3bbb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22677f expref: 13 pid: 6673 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940801.600379:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 81 00000100:00100000:2.0:1788940801.600391:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:2358:x1875840036075392:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940801.600419:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940801.600449:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3bbb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22677f expref: 13 pid: 6673 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.600467:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3bbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22677f expref: 13 pid: 6673 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.600732:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940801.600737:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940801.600748:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e83ade61/0xa1d8aa9164aa3bc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226786 expref: 13 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.600760:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e83ade61/0xa1d8aa9164aa3bc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226786 expref: 13 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.600811:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e83ade61/0xa1d8aa9164aa3bc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226786 expref: 13 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940801.600829:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a6ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5819:1875840068569088:192.168.202.17@tcp:105: 00000100:00100000:2.0:1788940801.600941:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f412baef780 going to sleep for 11 seconds 00010000:00010000:0.0:1788940801.602898:0:6671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3bbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22677f expref: 13 pid: 6673 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.602934:0:6671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134c57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6671:1875840068568960:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940801.602974:0:6671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e83ade61/0xa1d8aa9164aa3bc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226786 expref: 12 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.603017:0:6671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100031200, rc 0) 00000100:00100000:0.0:1788940801.603100:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+12:11620:x1875840036075264:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 7929us (8167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940801.603112:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 64 00010000:00010000:3.0:1788940801.609972:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940801.612099:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940801.612233:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036075520 00000100:00100000:1.0:1788940801.612246:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036075520 00002000:00100000:1.0:1788940801.612315:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8f413a5c8380 x1875840036075520/t0(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:22/0 lens 504/0 e 0 to 0 dl 1788940812 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940801.612331:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f413a5c8380 with x1875840036075520 ext(0->12) 00002000:00010000:1.0:1788940801.612339:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f413a5c8380 00000100:00100000:1.0:1788940801.612379:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00100000:1.0:1788940801.612390:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+12:2358:x1875840036075520:12345-192.168.202.17@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788940801.613029:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:2358:x1875840036075520:12345-192.168.202.17@tcp:4:lhsmtool_posix.0 Request processed in 633us (940us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788940801.613039:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 6 00002000:00100000:1.0:1788940801.613049:0:6677:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8f413a5c8380 x1875840036075520/t4294967320(0) o4->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:22/0 lens 504/448 e 0 to 0 dl 1788940812 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940801.613059:0:6677:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f413a5c8380 with x1875840036075520 ext(0->12) 00002000:00010000:1.0:1788940801.613064:0:6677:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f413a5c8380 00000100:00100000:2.0:1788940801.615812:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a6ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5819:1875840068569088:192.168.202.17@tcp:105: 00010000:00010000:2.0:1788940801.615852:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940801.615949:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:2358:x1875840036075392:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 15558us (15968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940801.615963:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 81 00000100:00100000:3.0:1788940801.617318:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940801.620246:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036075648 00000100:00100000:1.0:1788940801.620268:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036075648 00000100:00100000:1.0:1788940801.620363:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 226 00000100:00100000:1.0:1788940801.620375:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+66:11620:x1875840036075648:12345-192.168.202.17@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788940801.693810:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967491 is committed 00000004:00080000:1.0:1788940801.693857:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:1.0:1788940801.693885:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000020:00080000:1.0:1788940801.693924:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f41109d8540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788940801.693928:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f410381d600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f41109d8e40 00000020:00080000:1.0:1788940801.693931:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f410381d100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f4102bab400 00000004:00080000:1.0:1788940801.693958:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:1.0:1788940801.694000:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788940801.694005:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788940801.694017:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f4103511180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788940801.694020:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f4134b10e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f4103511c00 00000020:00080000:1.0:1788940801.694022:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f4134b10200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f41352b6000 00000020:00080000:1.0:1788940801.694040:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788940801.694583:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788940801.694904:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:11620:x1875840036075648:12345-192.168.202.17@tcp:44:lhsmtool_posix.0 Request processed in 74516us (77583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940801.694916:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 226 00000100:00100000:1.0:1788940801.695357:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940801.695373:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f400261d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068569216:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788940801.695581:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068569472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788940801.695632:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940801.695740:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068569472 00000100:00100000:3.0:1788940801.695750:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068569472 00000100:00100000:3.0:1788940801.695798:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788940801.695805:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875840068569472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788940801.695956:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788940801.695959:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788940800 00002000:00010000:3.0:1788940801.695961:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788940801.695975:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788940800 -> 1788940800 00002000:00010000:3.0:1788940801.695977:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788940801.696005:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1875840068569472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (372us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788940801.696010:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:3.0:1788940801.696050:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f413a5ca300/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788940801.696054:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068569472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788940801.696251:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940801.696529:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068569216 00000100:00100000:3.0:1788940801.696533:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068569216 00000100:00100000:3.0:1788940801.696558:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788940801.696562:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875840068569216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788940801.696582:0:8426:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788940801.696611:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa111ff, atime: 0x6aa111ff, ctime: 0x6aa111ff, blocks: 0x1 00010000:00010000:3.0:1788940801.696619:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025f8a2f6/0xa1d8aa9164aa3bc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.696635:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1788940801.696640:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940801.696647:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025f8a2f6/0xa1d8aa9164aa3bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940801.698362:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a5cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068569344:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788940801.698473:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788940801.699075:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025f8a2f6/0xa1d8aa9164aa3bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.699092:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025f8a2f6/0xa1d8aa9164aa3bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.699456:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068569344 00000100:00100000:0.0:1788940801.699467:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068569344 00000100:00100000:0.0:1788940801.699526:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940801.699534:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1875840068569344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788940801.699566:0:6673:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788940801.699595:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee82f19b/0xa1d8aa9164aa3bd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.699614:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc9c6740/0xa1d8aa9164aa398b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266e5 expref: 12 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.699621:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788940801.699625:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940801.699628:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee82f19b/0xa1d8aa9164aa3bd0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.699777:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc9c6740/0xa1d8aa9164aa398b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266e5 expref: 12 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.699791:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc9c6740/0xa1d8aa9164aa398b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266e5 expref: 12 pid: 8426 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.699816:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134c57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6673:1875840068569600:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940801.699884:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a068000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940801.699930:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940801.701337:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788940801.701356:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788940801.701967:0:6671:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788940801.701976:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036075776 00000100:00100000:0.0:1788940801.701986:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036075776 00010000:00010000:3.0:1788940801.702396:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025f8a2f6/0xa1d8aa9164aa3bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.702431:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940801.702461:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940801.702470:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025f8a2f6/0xa1d8aa9164aa3bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.702501:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f42800 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940801.702506:0:7621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025f8a2f6/0xa1d8aa9164aa3bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.702518:0:7621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025f8a2f6/0xa1d8aa9164aa3bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.702544:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025f8a2f6/0xa1d8aa9164aa3bc9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.702553:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025f8a2f6/0xa1d8aa9164aa3bc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.702584:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940801.702586:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940801.702587:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940801.703332:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134c57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6673:1875840068569600:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940801.703365:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ee82f19b/0xa1d8aa9164aa3bd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.703949:0:12520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 68 00000100:00100000:0.0:1788940801.703993:0:12520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:2358:x1875840036075776:12345-192.168.202.17@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788940801.704787:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940801.704931:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036075904 00000100:00100000:0.0:1788940801.704942:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036075904 00010000:00010000:0.0:1788940801.704981:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9c6740/0xa1d8aa9164aa398b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266e5 expref: 14 pid: 8426 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.705020:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 82 00000100:00100000:0.0:1788940801.705028:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+14:2358:x1875840036075904:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940801.705044:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940801.705050:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc9c6740/0xa1d8aa9164aa398b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266e5 expref: 14 pid: 8426 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.705064:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc9c6740/0xa1d8aa9164aa398b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266e5 expref: 14 pid: 8426 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.705092:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc9c6740/0xa1d8aa9164aa398b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266e5 expref: 14 pid: 8426 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.705146:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940801.705152:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788940801.705159:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee82f19b/0xa1d8aa9164aa3bd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.705170:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee82f19b/0xa1d8aa9164aa3bd0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.705217:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940801.705227:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ee82f19b/0xa1d8aa9164aa3bd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.705292:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+13:2358:x1875840036075904:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 263us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940801.705300:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 82 00010000:00010000:2.0:1788940801.705312:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee82f19b/0xa1d8aa9164aa3bd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.705336:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee82f19b/0xa1d8aa9164aa3bd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.705345:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee82f19b/0xa1d8aa9164aa3bd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.705368:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788940801.708904:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3304:x1875840068569344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9359us (10420us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788940801.708924:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788940801.709400:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1875840068569216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12832us (13145us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788940801.709423:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:3.0:1788940801.709458:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940801.709468:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee82f19b/0xa1d8aa9164aa3bd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.709495:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030200 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940801.709500:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee82f19b/0xa1d8aa9164aa3bd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.709512:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee82f19b/0xa1d8aa9164aa3bd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.709536:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee82f19b/0xa1d8aa9164aa3bd0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.709543:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee82f19b/0xa1d8aa9164aa3bd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.709569:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940801.709587:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940801.709589:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788940801.713451:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f413a5cb480/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788940801.713473:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a5cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068569344:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788940801.713502:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f400261d880/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788940801.713508:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f400261d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068569216:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788940801.754584:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:1.0:1788940801.754608:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1788940801.754651:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:3.0:1788940801.754953:0:12520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fbe6afa-4201-4af1-bbe2-c715064eeb39+11:2358:x1875840036075776:12345-192.168.202.17@tcp:16:lhsmtool_posix.0 Request processed in 50978us (55010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940801.754969:0:12520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 68 00000001:00080000:1.0:1788940801.755448:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1788940801.759678:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940801.759940:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036076160 00000100:00100000:0.0:1788940801.759956:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036076160 00000100:00100000:0.0:1788940801.760042:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 227 00000100:00100000:0.0:1788940801.760055:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:11620:x1875840036076160:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788940801.760139:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940801.760182:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5600/0xa1d8aa9164aa3bb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226778 expref: 20 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.760238:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4112cbfd00) 00010000:00010000:0.0:1788940801.760245:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940801.760288:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3bd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.760306:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.760338:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940801.761358:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e2bcbfc reply state 00000000b9a823c3 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.761376:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940801.761863:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:11620:x1875840036076160:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 1806us (2206us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788940801.761874:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 227 00000100:00100000:0.0:1788940801.765118:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00010000:00010000:2.0:1788940801.766164:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.766184:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3bd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.766216:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.766224:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940801.766230:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.766240:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3bd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.766263:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4112cbfd00) 00010000:00010000:2.0:1788940801.766276:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788940801.766303:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3bd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.766310:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3bd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940801.769385:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036076288 00000100:00100000:1.0:1788940801.769626:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036076288 00000100:00100000:1.0:1788940801.770023:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 69 00000100:00100000:1.0:1788940801.770038:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2359:x1875840036076288:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788940801.770397:0:6671:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788940801.770402:0:6671:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788940800 -> 1788940799 00002000:00010000:1.0:1788940801.770418:0:6671:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788940799 00002000:00010000:1.0:1788940801.770420:0:6671:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788940800 -> 1788940799 00002000:00010000:1.0:1788940801.770422:0:6671:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788940801.770537:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2359:x1875840036076288:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 Request processed in 501us (5430us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788940801.770546:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 69 00000100:00100000:2.0:1788940801.773132:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940801.773229:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036076544 00000100:00100000:3.0:1788940801.773243:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036076544 00000100:00100000:3.0:1788940801.773310:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 228 00000100:00100000:3.0:1788940801.773320:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:11620:x1875840036076544:12345-192.168.202.17@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788940801.773422:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.773446:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22676a expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.773457:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.773504:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22676a expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.773520:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22676a expref: 20 pid: 5834 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940801.773538:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a5cb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875840068569728:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940801.773713:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41071a1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940801.781335:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940801.781547:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036076672 00000100:00100000:0.0:1788940801.781559:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036076672 00010000:00010000:0.0:1788940801.781609:0:7622:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b98 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22676a expref: 21 pid: 5834 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.781700:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 83 00000100:00100000:0.0:1788940801.781712:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:2358:x1875840036076672:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940801.781731:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940801.781739:0:7622:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b98 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22676a expref: 21 pid: 5834 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.781754:0:7622:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22676a expref: 21 pid: 5834 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.781784:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4112cbfd00) 00010000:00010000:0.0:1788940801.781790:0:7622:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.781823:0:7622:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.781833:0:7622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.781859:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940801.781934:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:2358:x1875840036076672:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 224us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940801.781941:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 83 00010000:00010000:3.0:1788940801.782017:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3b98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22676a expref: 20 pid: 5834 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940801.782048:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a5cb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875840068569728:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940801.782078:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.782088:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.782095:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.782147:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.782156:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.782164:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.782170:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f43000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940801.782175:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.782183:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.782221:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4112cbfd00) 00010000:00010000:3.0:1788940801.782223:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788940801.782228:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.782250:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3bde lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940801.782293:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:11620:x1875840036076544:12345-192.168.202.17@tcp:55:lhsmtool_posix.0 Request processed in 8974us (9184us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788940801.782301:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 228 00000100:00100000:1.0:1788940801.785725:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940801.786061:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036076800 00000100:00100000:2.0:1788940801.786076:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036076800 00000100:00100000:2.0:1788940801.786223:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 70 00000100:00100000:2.0:1788940801.786248:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2361:x1875840036076800:12345-192.168.202.17@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788940801.786314:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009945a42c/0xa1d8aa9164aa3be5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.786341:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e83ade61/0xa1d8aa9164aa3bc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226786 expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.786351:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788940801.786357:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940801.786362:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009945a42c/0xa1d8aa9164aa3be5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.786420:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e83ade61/0xa1d8aa9164aa3bc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226786 expref: 8 pid: 6671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.786436:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e83ade61/0xa1d8aa9164aa3bc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226786 expref: 8 pid: 6671 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940801.786452:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a6ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6673:1875840068569856:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940801.786594:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4101359240 going to sleep for 11 seconds 00000100:00100000:1.0:1788940801.790422:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940801.790588:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036076928 00000100:00100000:3.0:1788940801.790601:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036076928 00010000:00010000:3.0:1788940801.790726:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e83ade61/0xa1d8aa9164aa3bc2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226786 expref: 9 pid: 6671 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940801.790771:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 84 00000100:00100000:3.0:1788940801.790783:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2359:x1875840036076928:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940801.790803:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940801.790835:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e83ade61/0xa1d8aa9164aa3bc2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226786 expref: 9 pid: 6671 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.790851:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e83ade61/0xa1d8aa9164aa3bc2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226786 expref: 9 pid: 6671 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.790881:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940801.790885:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788940801.790893:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009945a42c/0xa1d8aa9164aa3be5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.790905:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009945a42c/0xa1d8aa9164aa3be5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.790947:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940801.791008:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+9:2359:x1875840036076928:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 227us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940801.791016:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 84 00010000:00010000:0.0:1788940801.792137:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e83ade61/0xa1d8aa9164aa3bc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226786 expref: 8 pid: 6671 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.792166:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a6ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6673:1875840068569856:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940801.792254:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009945a42c/0xa1d8aa9164aa3be5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.792267:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009945a42c/0xa1d8aa9164aa3be5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.792275:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009945a42c/0xa1d8aa9164aa3be5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.792324:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009945a42c/0xa1d8aa9164aa3be5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.792377:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009945a42c/0xa1d8aa9164aa3be5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.792387:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009945a42c/0xa1d8aa9164aa3be5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.792397:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7000 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940801.792402:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009945a42c/0xa1d8aa9164aa3be5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.792413:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009945a42c/0xa1d8aa9164aa3be5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.792436:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009945a42c/0xa1d8aa9164aa3be5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.792445:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009945a42c/0xa1d8aa9164aa3be5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.792808:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2361:x1875840036076800:12345-192.168.202.17@tcp:1:lhsmtool_posix.0 Request processed in 6570us (7164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940801.792821:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 70 00000100:00100000:1.0:1788940801.796508:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940801.796633:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036077184 00000100:00100000:2.0:1788940801.796647:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036077184 00000100:00100000:2.0:1788940801.796790:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 229 00000100:00100000:2.0:1788940801.796803:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:11620:x1875840036077184:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788940801.796912:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3bec lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.796934:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3bec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.796950:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3bec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.797303:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.797316:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3ba6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226771 expref: 20 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.797326:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.797372:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226771 expref: 20 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.797388:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3ba6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226771 expref: 20 pid: 7198 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940801.797406:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a6ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068569984:192.168.202.17@tcp:104: 00000100:00100000:2.0:1788940801.797542:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4142151600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940801.802111:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a6ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068569984:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940801.802229:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940801.803133:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940801.803531:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036077312 00000100:00100000:2.0:1788940801.803542:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036077312 00010000:00010000:2.0:1788940801.803593:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3ba6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226771 expref: 21 pid: 7198 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940801.803644:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 85 00000100:00100000:2.0:1788940801.803662:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:2358:x1875840036077312:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940801.803682:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940801.803690:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3ba6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226771 expref: 21 pid: 7198 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.803704:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226771 expref: 21 pid: 7198 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.803730:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3ba6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226771 expref: 21 pid: 7198 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.803751:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4112cbfd00) 00010000:00010000:2.0:1788940801.803757:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.803768:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.803776:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.803806:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940801.803903:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:2358:x1875840036077312:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 250us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940801.803912:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 85 00010000:00010000:1.0:1788940801.804360:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940801.804371:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940801.804616:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788940801.804793:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788940801.804838:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788940801.805048:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41350f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1875840068570112:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788940801.805115:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940801.805770:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a0680c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940801.806512:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068570112 00000100:00100000:2.0:1788940801.806526:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068570112 00000100:00100000:2.0:1788940801.806606:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940801.806618:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1875840068570112:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788940801.806795:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1875840068570112:12345-0@lo:1000:mdt00_002.0 Request processed in 178us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940801.806803:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940801.807068:0:5835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1788940801.807075:0:5835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1788940801.807101:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f413a5ca300, transno 4294967321 00000100:00100000:1.0:1788940801.807135:0:5835:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8f413a5cb480 x1875840068569344/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788940817 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940801.807151:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41350f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1875840068570112:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788940801.807776:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788940801.807914:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41350f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1875840068570240:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788940801.807981:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940801.808026:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a068600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940801.808523:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068570240 00000100:00100000:0.0:1788940801.808533:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068570240 00000100:00100000:0.0:1788940801.808590:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940801.808611:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1875840068570240:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788940801.808882:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1875840068570240:12345-0@lo:1000:mdt00_002.0 Request processed in 272us (900us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788940801.808890:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940801.808943:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41350f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1875840068570240:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788940801.808991:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809004:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809013:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809020:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940801.809026:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809035:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809056:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f4112cbfd00) 00010000:00010000:0.0:1788940801.809059:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940801.809066:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809074:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa3bf3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809112:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3b36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809136:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3b36 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809143:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3b36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809149:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940801.809152:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3b36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809158:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3b36 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809167:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:0.0:1788940801.809170:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940801.809178:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031800/0xa1d8aa9164aa3b3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226755 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809299:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031800/0xa1d8aa9164aa3b3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226755 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809313:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031800/0xa1d8aa9164aa3b3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226755 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.809349:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031800/0xa1d8aa9164aa3b3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226755 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.809364:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134c55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068570368:192.168.202.17@tcp:105: 00000100:00100000:0.0:1788940801.809607:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4114591480 going to sleep for 11 seconds 00000100:00100000:1.0:1788940801.828264:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940801.828403:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134c55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875840068570368:192.168.202.17@tcp:105: 00010000:00010000:0.0:1788940801.828456:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3b36 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828472:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3b36 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828533:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3bfa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828552:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3bfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828565:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3bfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828580:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3bfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828587:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3bfa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828595:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3bfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828601:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940801.828605:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3bfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828613:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3bfa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828649:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:0.0:1788940801.828653:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940801.828666:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3bfa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828673:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3bfa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828685:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3bec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828691:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3bec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828696:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3bec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828701:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940801.828703:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3bec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828710:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3bec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828717:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:0.0:1788940801.828720:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788940801.828723:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3bec lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.828728:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa3bec lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.829042:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:11620:x1875840036077184:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 32239us (32554us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788940801.829053:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 229 00000020:00080000:0.0:1788940801.829060:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788940801.829584:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036077440 00000100:00100000:3.0:1788940801.829596:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036077440 00000100:00100000:3.0:1788940801.829666:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 61 00000100:00100000:3.0:1788940801.829677:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:11619:x1875840036077440:12345-192.168.202.17@tcp:49:lfs.0 00000100:00100000:3.0:1788940801.829805:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:11619:x1875840036077440:12345-192.168.202.17@tcp:49:lfs.0 Request processed in 129us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940801.829812:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 61 00000040:00080000:1.0:1788940801.830488:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788940801.830496:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940801.830997:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788940801.831014:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788940801.837783:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940801.837955:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036077696 00000100:00100000:2.0:1788940801.837969:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036077696 00000100:00100000:2.0:1788940801.838041:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 230 00000100:00100000:2.0:1788940801.838053:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:11619:x1875840036077696:12345-192.168.202.17@tcp:58:lfs.0 00000040:00080000:2.0:1788940801.838621:0:7198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788940801.838824:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:11619:x1875840036077696:12345-192.168.202.17@tcp:58:lfs.0 Request processed in 769us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940801.838833:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 230 00000100:00100000:2.0:1788940801.849712:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940801.849875:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036077952 00000100:00100000:3.0:1788940801.849891:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036077952 00000100:00100000:3.0:1788940801.849970:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 62 00000100:00100000:3.0:1788940801.849983:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41057c6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+23:11620:x1875840036077952:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788940801.852073:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788940801.852585:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788940801.853973:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa3c01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.854004:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa3c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.854020:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa3c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.854046:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa3c01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.854054:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa3c01 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.854062:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa3c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940801.854107:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788940801.857054:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41057c6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+25:11620:x1875840036077952:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 Request processed in 7058us (7342us total) trans 4294967514 rc 0/0 00010000:00010000:3.0:1788940801.857183:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940801.857227:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa3c01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.857246:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6a00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940801.857252:0:7620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa3c01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.857264:0:7620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa3c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.857310:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8f41054d7d00) 00010000:00010000:3.0:1788940801.857313:0:7620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788940801.857320:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa3c01 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.857326:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6a00/0xa1d8aa9164aa3c01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.857361:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940801.857363:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940801.857365:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940801.858391:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 62 00000020:00080000:2.0:1788940801.858416:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788940801.882840:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940801.883971:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036078080 00000100:00100000:0.0:1788940801.883993:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036078080 00000100:00100000:0.0:1788940801.884099:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 231 00000100:00100000:0.0:1788940801.884113:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+25:11622:x1875840036078080:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940801.884157:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940801.884233:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3c08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22678d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.884329:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3c0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.884349:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3c0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.884363:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3c0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.884381:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3c16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.884388:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.884395:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.885433:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3c1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.885456:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22674e expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.885467:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3c1d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.886263:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22674e expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940801.886286:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22674e expref: 26 pid: 5835 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940801.886306:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134c56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875840068570496:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940801.886480:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4114591480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940801.895414:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940801.896805:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036078336 00000100:00100000:1.0:1788940801.896825:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036078336 00000100:00100000:1.0:1788940801.896929:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 63 00000100:00100000:1.0:1788940801.896942:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:5602:x1875840036078336:12345-192.168.202.17@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788940801.897379:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:5602:x1875840036078336:12345-192.168.202.17@tcp:35:ldlm_bl.0 Request processed in 437us (1980us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788940801.897388:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 63 00000100:00100000:0.0:1788940801.903293:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940801.903522:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036078464 00000100:00100000:3.0:1788940801.903536:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036078464 00010000:00010000:3.0:1788940801.903594:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22674e expref: 28 pid: 5835 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940801.903636:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 86 00000100:00100000:3.0:1788940801.903648:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41080e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:2359:x1875840036078464:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940801.903678:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940801.903687:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22674e expref: 28 pid: 5835 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.903702:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22674e expref: 28 pid: 5835 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.903731:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:3.0:1788940801.903738:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3c1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.903774:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.903783:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3c1d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.903808:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940801.903886:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41080e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:2359:x1875840036078464:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 239us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940801.903894:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 86 00010000:00010000:2.0:1788940801.908117:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa3b28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22674e expref: 27 pid: 5835 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940801.908162:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134c56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1875840068570496:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940801.908250:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.908383:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.908393:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940801.908457:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788940801.908464:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788940801.908502:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.908531:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.908544:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3c0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.908550:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3c0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.908559:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3c0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.908594:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100031400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940801.908599:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3c0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.908608:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3c0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.908626:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:3.0:1788940801.908630:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940801.908635:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3c0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.908641:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031400/0xa1d8aa9164aa3c0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.911092:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.911129:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3c16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.911140:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.911149:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100031200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940801.911154:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.911164:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3c16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.911249:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8f410ad9f200) 00010000:00010000:3.0:1788940801.911253:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940801.911260:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3c16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.911267:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031200/0xa1d8aa9164aa3c16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.911353:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030e00/0xa1d8aa9164aa3c08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22678d expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.911370:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3c1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22678d expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940801.911378:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:3.0:1788940801.911381:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788940801.911384:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100030800, rc 0) 00000100:00100000:3.0:1788940801.911757:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:11622:x1875840036078080:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 27644us (28932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940801.911771:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 231 00010000:00010000:1.0:1788940802.645687:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788940802.653920:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1788940802.653954:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1788940802.653962:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000040:00080000:0.0:1788940802.790875:0:12559:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940802.790890:0:12559:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940802.790975:0:12559:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788940802.790984:0:12559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788940802.896387:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940802.896727:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940802.896790:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788940802.896796:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788940802.896970:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a5c8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875840068570624:192.168.202.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788940802.897146:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940802.911322:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940802.911651:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036078592 00000100:00100000:3.0:1788940802.911681:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036078592 00000100:00100000:3.0:1788940802.911786:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 232 00000100:00100000:3.0:1788940802.911801:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:11634:x1875840036078592:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788940802.911862:0:7198:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788940802.912027:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:11634:x1875840036078592:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 Request processed in 229us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940802.912035:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 232 00000100:00100000:1.0:1788940802.912741:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a5c8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875840068570624:192.168.202.17@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788940802.917154:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940802.917504:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036078848 00000100:00100000:1.0:1788940802.917517:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036078848 00000100:00100000:1.0:1788940802.917583:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 233 00000100:00100000:1.0:1788940802.917596:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+26:11634:x1875840036078848:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940802.917627:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940802.917656:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa3c24 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226794 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940802.917824:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940802.917844:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940802.917864:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940802.917878:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788940802.918059:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5400/0xa1d8aa9164aa3c24 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226794 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940802.918100:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226794 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940802.918123:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:1.0:1788940802.918127:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940802.918132:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4c00, rc 0) 00000100:00100000:1.0:1788940802.918250:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:11634:x1875840036078848:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 656us (1109us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788940802.918259:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 233 00000100:00100000:2.0:1788940802.923619:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940802.923673:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940802.923752:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036079232 00000100:00100000:1.0:1788940802.923766:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036079232 00000100:00100000:1.0:1788940802.923868:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:1.0:1788940802.923881:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:2361:x1875840036079232:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940802.923902:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940802.923934:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4c00/0xa1d8aa9164aa3c2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226794 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940802.923955:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:1.0:1788940802.923961:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940802.924038:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:2361:x1875840036079232:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 159us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940802.924047:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:3.0:1788940802.925564:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036079104 00000100:00100000:3.0:1788940802.925582:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036079104 00000100:00100000:3.0:1788940802.925663:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 234 00000100:00100000:3.0:1788940802.925676:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+27:11634:x1875840036079104:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788940802.925785:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3c39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940802.925805:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940802.925818:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940802.927069:0:7198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3c39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940802.927087:0:7198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3c39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940802.927096:0:7198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3c39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940802.927104:0:7198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f43000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940802.927128:0:7198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3c39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940802.927138:0:7198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3c39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940802.927159:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:3.0:1788940802.927163:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788940802.927169:0:7198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3c39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940802.927177:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3c39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940802.928077:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:11634:x1875840036079104:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 2396us (4467us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788940802.928094:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 234 00000100:00100000:3.0:1788940802.934274:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940802.934428:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036079488 00000100:00100000:1.0:1788940802.934443:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036079488 00000100:00100000:1.0:1788940802.934518:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 64 00000100:00100000:1.0:1788940802.934549:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+28:11634:x1875840036079488:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788940802.934856:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+29:11634:x1875840036079488:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 Request processed in 310us (597us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788940802.934865:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 64 00000040:00080000:2.0:1788940802.936780:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788940802.936793:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940802.939080:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788940802.939125:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788940803.080809:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41350f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068570880:0@lo:400:kworker.0 00000100:00100000:1.0:1788940803.080924:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940803.081037:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068570880 00000100:00100000:1.0:1788940803.081047:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068570880 00000100:00100000:1.0:1788940803.081136:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788940803.081148:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068570880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940803.081240:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068570880:12345-0@lo:400:kworker.0 Request processed in 94us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940803.081248:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788940803.081305:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41350f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068570880:0@lo:400:kworker.0 00000100:00100000:1.0:1788940803.081351:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41350f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068571008:0@lo:400:kworker.0 00000100:00100000:1.0:1788940803.081380:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940803.081414:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068571008 00000100:00100000:1.0:1788940803.081419:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068571008 00000100:00100000:1.0:1788940803.081457:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788940803.081464:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068571008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940803.081499:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068571008:12345-0@lo:400:kworker.0 Request processed in 35us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940803.081506:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:1.0:1788940803.081524:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940803.081544:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41350f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068571008:0@lo:400:kworker.0 00000100:00100000:1.0:1788940803.081616:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41350f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068571392:0@lo:400:kworker.0 00000100:00100000:1.0:1788940803.081647:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940803.082202:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41350f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068570752:0@lo:400:kworker.0 00000100:00100000:3.0:1788940803.082250:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940803.082286:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41350f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068571264:0@lo:400:kworker.0 00000100:00100000:3.0:1788940803.082312:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940803.082331:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940803.082336:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41350f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068571136:0@lo:400:kworker.0 00000100:00100000:3.0:1788940803.082358:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940803.082390:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068571264 00000100:00100000:3.0:1788940803.082395:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068571264 00000100:00100000:3.0:1788940803.082442:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788940803.082450:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068571264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940803.082503:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068571264:12345-0@lo:400:kworker.0 Request processed in 54us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940803.082511:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788940803.082534:0:12520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068571392 00000100:00100000:3.0:1788940803.082538:0:12520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068571392 00000100:00100000:3.0:1788940803.082562:0:12520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068571136 00000100:00100000:3.0:1788940803.082564:0:12520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068571136 00000100:00100000:3.0:1788940803.082606:0:12520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788940803.082613:0:12520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068571392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940803.082649:0:12520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068571392:12345-0@lo:400:kworker.0 Request processed in 37us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940803.082655:0:12520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788940803.082667:0:12520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788940803.082674:0:12520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3302:x1875840068571136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940803.082701:0:12520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3302:x1875840068571136:12345-0@lo:400:kworker.0 Request processed in 29us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940803.082707:0:12520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1788940803.082729:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940803.082733:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940803.082736:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940803.082759:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41350f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068571136:0@lo:400:kworker.0 00000100:00100000:3.0:1788940803.082770:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41350f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068571264:0@lo:400:kworker.0 00000100:00100000:1.0:1788940803.083251:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068570752 00000100:00100000:1.0:1788940803.083259:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068570752 00000100:00100000:1.0:1788940803.083306:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788940803.083315:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068570752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940803.083369:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068570752:12345-0@lo:400:kworker.0 Request processed in 55us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940803.083376:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788940803.083423:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41350f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068570752:0@lo:400:kworker.0 00000100:00100000:1.0:1788940803.083451:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788940803.083459:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788940803.083478:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f400261d880, transno 4294967310 00000100:00100000:1.0:1788940803.083490:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41350f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068571392:0@lo:400:kworker.0 00000100:00100000:3.0:1788940803.594546:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41350f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068571520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940803.594649:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940803.595043:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068571520 00000100:00100000:1.0:1788940803.595054:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068571520 00000100:00100000:1.0:1788940803.595131:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788940803.595143:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068571520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940803.595357:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940803.595428:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068571520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 287us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940803.595437:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788940803.595537:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41350f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068571520:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788940803.656588:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940804.680399:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940804.763549:0:12610:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788940804.763566:0:12610:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788940804.763632:0:12610:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788940804.763639:0:12610:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788940804.957034:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940804.957135:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036079744 00000100:00100000:3.0:1788940804.957149:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036079744 00000100:00100000:3.0:1788940804.957338:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 235 00000100:00100000:3.0:1788940804.957354:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+29:11655:x1875840036079744:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:3.0:1788940804.957391:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940804.957420:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3c40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22679b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940804.957585:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3c47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940804.957605:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3c47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940804.957621:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3c47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788940804.957636:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788940804.957801:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43000/0xa1d8aa9164aa3c40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22679b expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940804.957823:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3c47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22679b expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940804.957833:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:3.0:1788940804.957837:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788940804.957843:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4140f42a00, rc 0) 00000100:00100000:3.0:1788940804.957923:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+31:11655:x1875840036079744:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 574us (905us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788940804.957951:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 235 00000100:00100000:0.0:1788940804.963507:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940804.963783:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036079872 00000100:00100000:3.0:1788940804.963797:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036079872 00000100:00100000:3.0:1788940804.963943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 236 00000100:00100000:3.0:1788940804.963960:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+31:11655:x1875840036079872:12345-192.168.202.17@tcp:54:lfs.0 00010000:00010000:3.0:1788940804.964068:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa3c55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940804.964104:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa3c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940804.964120:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa3c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940804.964158:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa3c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940804.964166:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa3c55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940804.964175:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa3c55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940804.964183:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f43200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940804.964213:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa3c55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940804.964223:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa3c55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940804.964236:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:3.0:1788940804.964254:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788940804.964262:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa3c55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940804.964269:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa3c55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940804.964370:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+31:11655:x1875840036079872:12345-192.168.202.17@tcp:54:lfs.0 Request processed in 414us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940804.964379:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 236 00000100:00080000:1.0:1788940804.965131:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940805.082212:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940805.082274:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036080000 00000100:00100000:1.0:1788940805.082287:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036080000 00000100:00100000:1.0:1788940805.082369:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 71 00000100:00100000:1.0:1788940805.082382:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2358:x1875840036080000:12345-192.168.202.17@tcp:101:cat.0 00010000:00010000:1.0:1788940805.082407:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940805.082435:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000702654e6/0xa1d8aa9164aa3c5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2267a2 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788940805.082486:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa111ff, atime: 0x6aa111ff, ctime: 0x6aa111ff, blocks: 0xb 00010000:00010000:1.0:1788940805.082514:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1788940805.082519:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940805.082531:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000702654e6/0xa1d8aa9164aa3c5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267a2 expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940805.082555:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000702654e6/0xa1d8aa9164aa3c5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267a2 expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940805.082572:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4200, rc 0) 00000100:00100000:1.0:1788940805.082650:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2358:x1875840036080000:12345-192.168.202.17@tcp:101:cat.0 Request processed in 270us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940805.082658:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 71 00000100:00080000:1.0:1788940805.082683:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940805.099595:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940805.099667:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036080128 00000100:00100000:1.0:1788940805.099681:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036080128 00002000:00100000:1.0:1788940805.099755:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8f41350f1500 x1875840036080128/t0(0) o3->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:26/0 lens 488/0 e 0 to 0 dl 1788940816 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940805.099783:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f41350f1500 with x1875840036080128 ext(0->4095) 00002000:00010000:1.0:1788940805.099790:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f41350f1500 00000100:00100000:1.0:1788940805.099825:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:1.0:1788940805.099837:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2360:x1875840036080128:12345-192.168.202.17@tcp:3:cat.0 00000100:00100000:1.0:1788940805.101614:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+8:2360:x1875840036080128:12345-192.168.202.17@tcp:3:cat.0 Request processed in 1765us (2018us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788940805.101630:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 7 00002000:00100000:1.0:1788940805.101642:0:6679:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8f41350f1500 x1875840036080128/t0(0) o3->9fbe6afa-4201-4af1-bbe2-c715064eeb39@192.168.202.17@tcp:26/0 lens 488/4536 e 0 to 0 dl 1788940816 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788940805.101653:0:6679:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f41350f1500 with x1875840036080128 ext(0->4095) 00002000:00010000:1.0:1788940805.101661:0:6679:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f41350f1500 00000100:00100000:1.0:1788940805.128611:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940805.128641:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41350f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068571648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940805.128739:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940805.128821:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068571648 00000100:00100000:1.0:1788940805.128832:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068571648 00000100:00100000:1.0:1788940805.129050:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788940805.129061:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875840068571648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940805.129125:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940805.129210:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875840068571648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940805.129217:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788940805.129244:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940805.129292:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41350f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068571648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940805.291662:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940805.291716:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940805.291797:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036080256 00000100:00100000:0.0:1788940805.291813:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036080256 00000100:00100000:0.0:1788940805.292054:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 307 00000100:00100000:0.0:1788940805.292068:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2358:x1875840036080256:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:0.0:1788940805.292247:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2358:x1875840036080256:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 182us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940805.292257:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 307 00000100:00100000:3.0:1788940805.292528:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036080384 00000100:00100000:3.0:1788940805.292534:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036080384 00000100:00100000:3.0:1788940805.292606:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 101 00000100:00080000:1.0:1788940805.292831:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940805.292892:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2359:x1875840036080384:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940805.292938:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2359:x1875840036080384:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 324us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940805.292946:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 101 00000100:00100000:2.0:1788940805.293074:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940805.293143:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036080512 00000100:00100000:3.0:1788940805.293148:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036080512 00000100:00100000:3.0:1788940805.293209:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 177 00000100:00100000:3.0:1788940805.293217:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2358:x1875840036080512:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940805.293254:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2358:x1875840036080512:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 38us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940805.293261:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 177 00000100:00080000:3.0:1788940805.293275:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788940805.707404:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940806.736342:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788940806.766547:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000001:00080000:2.0:1788940806.766567:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:2.0:1788940806.766590:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f413a0680c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788940806.766596:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f410381d900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f413a068540 00000020:00080000:2.0:1788940806.766599:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f410381d300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f413a6d5c00 00000020:00080000:2.0:1788940806.766641:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1788940806.766660:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788940806.766900:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788940806.768011:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1788940807.227021:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1788940807.227608:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:2.0:1788940807.752323:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940808.204058:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068571904:0@lo:400:kworker.0 00000100:00100000:3.0:1788940808.204087:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068572160:0@lo:400:kworker.0 00000100:00100000:1.0:1788940808.204222:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068571776:0@lo:400:kworker.0 00000100:00100000:3.0:1788940808.209168:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940808.209326:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068572032:0@lo:400:kworker.0 00000100:00100000:3.0:1788940808.209385:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940808.209428:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068572032 00000100:00100000:3.0:1788940808.209439:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068572032 00000100:00100000:3.0:1788940808.209526:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788940808.209540:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068572032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940808.209605:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068572032:12345-0@lo:400:kworker.0 Request processed in 69us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940808.209613:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:3.0:1788940808.209637:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940808.209671:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a694e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068572032:0@lo:400:kworker.0 00000100:00100000:2.0:1788940808.210396:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068572160 00000100:00100000:2.0:1788940808.210404:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068572160 00000100:00100000:2.0:1788940808.210461:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788940808.210470:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068572160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940808.210539:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068572160:12345-0@lo:400:kworker.0 Request processed in 71us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940808.210546:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788940808.211371:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940808.211435:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41352c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068572416:0@lo:400:kworker.0 00000100:00100000:0.0:1788940808.212236:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940808.212298:0:12520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068572416 00000100:00100000:0.0:1788940808.212308:0:12520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068572416 00000100:00100000:0.0:1788940808.212378:0:12520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788940808.212389:0:12520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068572416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940808.212453:0:12520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068572416:12345-0@lo:400:kworker.0 Request processed in 67us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940808.212475:0:12520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788940808.212543:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41352c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068572416:0@lo:400:kworker.0 00000100:00100000:2.0:1788940808.212799:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068571904 00000100:00100000:2.0:1788940808.212805:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068571904 00000100:00100000:2.0:1788940808.212849:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788940808.212858:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411141e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068571904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940808.212904:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411141e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068571904:12345-0@lo:400:kworker.0 Request processed in 48us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940808.212911:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788940808.213371:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068571904:0@lo:400:kworker.0 00000100:00100000:1.0:1788940808.213500:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940808.213545:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068572288:0@lo:400:kworker.0 00000100:00100000:1.0:1788940808.213583:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940808.213730:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068572288 00000100:00100000:2.0:1788940808.213752:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068572288 00000100:00100000:2.0:1788940808.213801:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788940808.213810:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068572288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940808.213853:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875840068572288:12345-0@lo:400:kworker.0 Request processed in 45us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940808.213860:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788940808.213929:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068571776 00000100:00100000:0.0:1788940808.213933:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068571776 00000100:00100000:1.0:1788940808.214059:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3302:1875840068572288:0@lo:400:kworker.0 00000100:00100000:0.0:1788940808.214182:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788940808.214212:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068571776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940808.214273:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068571776:12345-0@lo:400:kworker.0 Request processed in 63us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940808.214281:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788940808.214342:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068571776:0@lo:400:kworker.0 00000100:00080000:3.0:1788940808.214524:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788940808.214531:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940808.214535:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940808.214564:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788940808.214571:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f413a5cb480, transno 4294967322 00000004:00080000:3.0:1788940808.214583:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1788940808.214606:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068572160:0@lo:400:kworker.0 00000100:00100000:0.0:1788940808.712614:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068572544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940808.712729:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940808.712963:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068572544 00000100:00100000:3.0:1788940808.712976:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068572544 00000100:00100000:3.0:1788940808.713040:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788940808.713048:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40025aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068572544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940808.713110:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940808.713211:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40025aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068572544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940808.713237:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788940808.713675:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068572544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788940808.778319:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940809.695319:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940809.695870:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036080640 00000100:00100000:2.0:1788940809.695882:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036080640 00000100:00100000:2.0:1788940809.696075:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 237 00000100:00100000:2.0:1788940809.696088:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:11299:x1875840036080640:12345-192.168.202.17@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788940809.696224:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:11299:x1875840036080640:12345-192.168.202.17@tcp:60:lhsmtool_posix.0 Request processed in 138us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940809.696232:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 237 00000100:00080000:3.0:1788940809.696648:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940809.702561:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940809.702762:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036080896 00000100:00100000:1.0:1788940809.702772:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036080896 00000100:00100000:1.0:1788940809.702837:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 65 00000100:00100000:1.0:1788940809.702849:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:11299:x1875840036080896:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788940809.703491:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:11299:x1875840036080896:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 Request processed in 642us (938us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788940809.703501:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 65 00010000:00010000:3.0:1788940809.803290:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788940810.184591:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788940810.184608:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788940810.184982:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788940810.184991:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788940810.249512:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41350f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068572672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940810.249616:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940810.249969:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068572672 00000100:00100000:1.0:1788940810.249981:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068572672 00000100:00100000:1.0:1788940810.250074:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788940810.250087:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068572672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940810.250136:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940810.250226:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068572672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940810.250254:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788940810.250428:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940810.255666:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41350f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068572672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940810.418015:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940810.418103:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940810.418139:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036081024 00000100:00100000:0.0:1788940810.418155:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036081024 00000100:00100000:1.0:1788940810.418225:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940810.418249:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940810.418281:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 309 00000100:00100000:1.0:1788940810.418297:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940810.418298:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2361:x1875840036081024:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940810.418369:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036081536 00000100:00100000:2.0:1788940810.418374:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036081536 00000100:00100000:2.0:1788940810.418426:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036081152 00000100:00100000:2.0:1788940810.418429:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036081152 00000100:00100000:2.0:1788940810.418448:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 181 00000100:00100000:2.0:1788940810.418455:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2361:x1875840036081536:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940810.418556:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2361:x1875840036081536:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 100us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940810.418565:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 181 00000100:00100000:2.0:1788940810.418586:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 182 00000100:00100000:2.0:1788940810.418610:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:2361:x1875840036081152:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940810.418650:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:2361:x1875840036081152:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 41us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940810.418657:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 182 00000100:00080000:2.0:1788940810.418678:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940810.418963:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2361:x1875840036081024:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 671us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940810.418972:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 309 00000100:00100000:3.0:1788940810.428516:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036081280 00000100:00100000:3.0:1788940810.428591:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036081280 00000100:00100000:3.0:1788940810.428713:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036081408 00000100:00100000:3.0:1788940810.428716:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036081408 00000100:00100000:3.0:1788940810.428746:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 104 00000100:00100000:3.0:1788940810.428765:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2361:x1875840036081280:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940810.428881:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2361:x1875840036081280:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 125us (10778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940810.428889:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 104 00000100:00100000:3.0:1788940810.428907:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 105 00000100:00100000:3.0:1788940810.428914:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41350f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840036081408:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940810.428934:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41350f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2361:x1875840036081408:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 22us (10642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940810.428940:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 105 00000100:00080000:0.0:1788940810.429140:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940810.429146:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788940810.830561:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940811.848372:0:12816:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 04:00:09 (1788940809) 00010000:00010000:2.0:1788940811.854022:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788940811.864691:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788940811.864718:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788940811.864739:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788940811.864752:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788940812.873544:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940813.324146:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068572800:0@lo:400:kworker.0 00000100:00100000:3.0:1788940813.324317:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940813.324569:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068572928:0@lo:400:kworker.0 00000100:00100000:1.0:1788940813.324610:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940813.324666:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068572928 00000100:00100000:1.0:1788940813.324676:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068572928 00000100:00100000:1.0:1788940813.324736:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788940813.324746:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4101218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068572928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940813.324802:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4101218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068572928:12345-0@lo:400:kworker.0 Request processed in 58us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940813.324809:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788940813.324857:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068572928:0@lo:400:kworker.0 00000100:00100000:1.0:1788940813.324890:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f411129b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068573056:0@lo:400:kworker.0 00000100:00100000:1.0:1788940813.324913:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940813.324940:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068573056 00000100:00100000:1.0:1788940813.324943:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068573056 00000100:00100000:1.0:1788940813.324973:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788940813.324978:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068573056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940813.325008:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068573056:12345-0@lo:400:kworker.0 Request processed in 30us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940813.325042:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788940813.325070:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f411129b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068573056:0@lo:400:kworker.0 00000100:00100000:0.0:1788940813.325153:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068572800 00000100:00100000:0.0:1788940813.325158:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068572800 00000100:00100000:0.0:1788940813.325203:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788940813.325210:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068572800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940813.325456:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f400261f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068573184:0@lo:400:kworker.0 00000100:00100000:1.0:1788940813.325492:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940813.325542:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940813.325549:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f400261c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068573312:0@lo:400:kworker.0 00000100:00100000:1.0:1788940813.325573:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940813.325596:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068573312 00000100:00100000:1.0:1788940813.325600:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068573312 00000100:00100000:1.0:1788940813.325629:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788940813.325635:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f411129b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068573312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940813.325670:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f411129b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068573312:12345-0@lo:400:kworker.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940813.325676:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788940813.325702:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f400261c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068573312:0@lo:400:kworker.0 00000100:00100000:1.0:1788940813.325735:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f400261c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068573440:0@lo:400:kworker.0 00000100:00100000:1.0:1788940813.325778:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940813.325814:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068573184 00000100:00100000:1.0:1788940813.325818:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068573184 00000100:00100000:1.0:1788940813.325846:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068573440 00000100:00100000:1.0:1788940813.325849:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068573440 00000100:00100000:1.0:1788940813.325872:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788940813.325879:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f400261e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068573184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940813.325917:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f400261e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068573184:12345-0@lo:400:kworker.0 Request processed in 39us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940813.325934:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788940813.325947:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788940813.325952:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068573440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940813.325988:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068573440:12345-0@lo:400:kworker.0 Request processed in 35us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940813.325993:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788940813.326034:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f400261f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068573184:0@lo:400:kworker.0 00000100:00100000:1.0:1788940813.326057:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f400261c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068573440:0@lo:400:kworker.0 00000100:00080000:1.0:1788940813.330608:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940813.330624:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940813.330629:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940813.330866:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068572800:12345-0@lo:400:kworker.0 Request processed in 5647us (6540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940813.330885:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788940813.334910:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068572800:0@lo:400:kworker.0 00000100:00100000:2.0:1788940813.839589:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940813.839622:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a5cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068573568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940813.839718:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940813.839779:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068573568 00000100:00100000:3.0:1788940813.839790:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068573568 00000100:00100000:3.0:1788940813.839860:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788940813.839871:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41352c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068573568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940813.839920:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940813.839980:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41352c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068573568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940813.839989:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788940813.840057:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a5cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068573568:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788940813.902357:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940814.382021:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940814.382220:0:7198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036081664 00000100:00100000:1.0:1788940814.382233:0:7198:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036081664 00000100:00100000:1.0:1788940814.382314:0:7198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 238 00000100:00100000:1.0:1788940814.382327:0:7198:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:12319:x1875840036081664:12345-192.168.202.17@tcp:101:lsof.0 00010000:00010000:1.0:1788940814.382348:0:7198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940814.382369:0:7198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3c63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2267a9 expref: -99 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940814.382435:0:7198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa3c6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940814.382450:0:7198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa3c6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940814.382461:0:7198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa3c6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788940814.382610:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1788940814.382813:0:7198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940814.382818:0:7198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940814.382863:0:7198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa3c6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940814.382891:0:7198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4e00/0xa1d8aa9164aa3c63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267a9 expref: 7 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940814.382910:0:7198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa3c6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267a9 expref: 6 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940814.382919:0:7198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:1.0:1788940814.382922:0:7198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940814.382926:0:7198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4600, rc 0) 00000100:00100000:1.0:1788940814.386166:0:7198:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6703b9d8-8e00-4d48-b07a-3d1d34afc200+6:12319:x1875840036081664:12345-192.168.202.17@tcp:101:lsof.0 Request processed in 3831us (4154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940814.386179:0:7198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 238 00010000:00010000:1.0:1788940814.920712:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940815.368783:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940815.368822:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068573696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940815.369334:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940815.371468:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068573696 00000100:00100000:1.0:1788940815.371486:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068573696 00000100:00100000:1.0:1788940815.371594:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788940815.371606:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068573696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940815.371657:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940815.371759:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068573696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940815.371766:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788940815.372247:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068573696:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788940815.374378:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940815.529050:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940815.529111:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940815.529152:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940815.529306:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036082048 00000100:00100000:2.0:1788940815.529321:0:6671:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036082048 00000100:00100000:2.0:1788940815.529414:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 108 00000100:00100000:2.0:1788940815.529427:0:6671:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2360:x1875840036082048:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940815.529526:0:6671:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2360:x1875840036082048:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 101us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940815.529534:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 108 00000100:00080000:2.0:1788940815.529563:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940815.530058:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036081792 00000100:00100000:1.0:1788940815.530085:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036081792 00000100:00100000:1.0:1788940815.530125:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 311 00000100:00100000:1.0:1788940815.530133:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840036081792:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940815.530222:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840036081792:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 90us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940815.530229:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 311 00000100:00100000:3.0:1788940815.532689:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940815.534596:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036082304 00000100:00100000:2.0:1788940815.534617:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036082304 00000100:00100000:2.0:1788940815.534731:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 186 00000100:00100000:2.0:1788940815.534744:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+6:2360:x1875840036082304:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940815.534862:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6703b9d8-8e00-4d48-b07a-3d1d34afc200+6:2360:x1875840036082304:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 121us (5708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940815.534889:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 186 00000100:00100000:3.0:1788940815.535453:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940815.535659:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036082176 00000100:00100000:1.0:1788940815.535667:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036082176 00000100:00100000:1.0:1788940815.535735:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 109 00000100:00100000:1.0:1788940815.535744:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2360:x1875840036082176:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940815.535795:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2360:x1875840036082176:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 53us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940815.535802:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 109 00000100:00080000:0.0:1788940815.535901:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940815.536156:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036081920 00000100:00100000:2.0:1788940815.536161:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036081920 00000100:00100000:2.0:1788940815.536251:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 187 00000100:00100000:2.0:1788940815.536260:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:2360:x1875840036081920:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940815.536312:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:2360:x1875840036081920:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 54us (3637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940815.536320:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 187 00000100:00080000:0.0:1788940815.536469:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940815.828775:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940815.828930:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036082560 00000100:00100000:1.0:1788940815.828944:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036082560 00000100:00100000:1.0:1788940815.829049:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 66 00000100:00100000:1.0:1788940815.829062:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+18:12320:x1875840036082560:12345-192.168.202.17@tcp:35:umount.0 00000100:00100000:1.0:1788940815.829935:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:12320:x1875840036082560:12345-192.168.202.17@tcp:35:umount.0 Request processed in 870us (1168us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788940815.829946:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 66 00000100:00100000:0.0:1788940815.836451:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940815.836612:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036082816 00000100:00100000:2.0:1788940815.836626:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036082816 00000100:00100000:2.0:1788940815.836760:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 67 00000100:00100000:2.0:1788940815.836774:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+19:12320:x1875840036082816:12345-192.168.202.17@tcp:35:umount.0 00000100:00100000:2.0:1788940815.837616:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:12320:x1875840036082816:12345-192.168.202.17@tcp:35:umount.0 Request processed in 842us (1177us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788940815.837628:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 67 00000100:00100000:3.0:1788940815.840490:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940815.841493:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036083072 00000100:00100000:1.0:1788940815.841510:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036083072 00000100:00100000:1.0:1788940815.841578:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 68 00000100:00100000:1.0:1788940815.841589:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41057c6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+20:12320:x1875840036083072:12345-192.168.202.17@tcp:35:umount.0 00000100:00100000:1.0:1788940815.842108:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41057c6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:12320:x1875840036083072:12345-192.168.202.17@tcp:35:umount.0 Request processed in 517us (1630us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788940815.842137:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 68 00000100:00100000:3.0:1788940815.849254:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940815.849603:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036083328 00000100:00100000:2.0:1788940815.849618:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036083328 00000100:00100000:2.0:1788940815.849695:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 69 00000100:00100000:2.0:1788940815.849708:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+21:12320:x1875840036083328:12345-192.168.202.17@tcp:35:umount.0 00000100:00100000:2.0:1788940815.850485:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:12320:x1875840036083328:12345-192.168.202.17@tcp:35:umount.0 Request processed in 774us (1242us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788940815.850497:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 69 00000100:00100000:0.0:1788940815.854444:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940815.854524:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940815.859317:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940815.859650:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036083584 00000100:00100000:1.0:1788940815.859663:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036083584 00000100:00100000:1.0:1788940815.859746:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036083456 00000100:00100000:1.0:1788940815.859750:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036083456 00000100:00100000:1.0:1788940815.859779:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00100000:1.0:1788940815.859791:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f538000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd220973-afce-4e0b-b310-f94af7a18e79+14:2360:x1875840036083584:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940815.859812:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940815.859841:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142051200/0xa1d8aa9164aa2c56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226303 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940815.860029:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 20 00000100:00100000:3.0:1788940815.860060:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f539c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd220973-afce-4e0b-b310-f94af7a18e79+14:2360:x1875840036083456:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940815.860070:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940815.860080:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4136235400/0xa1d8aa9164aa2cf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22633b expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940815.860100:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940815.860211:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f539c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd220973-afce-4e0b-b310-f94af7a18e79+13:2360:x1875840036083456:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 132us (5663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940815.860219:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 20 00010000:00010000:1.0:1788940815.861694:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940815.861821:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f538000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd220973-afce-4e0b-b310-f94af7a18e79+11:2360:x1875840036083584:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 2028us (7390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940815.861832:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00100000:0.0:1788940815.863243:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940815.863524:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036083712 00000100:00100000:1.0:1788940815.863535:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036083712 00000100:00100000:1.0:1788940815.863605:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 21 00000100:00100000:1.0:1788940815.863615:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f53b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd220973-afce-4e0b-b310-f94af7a18e79+11:2361:x1875840036083712:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940815.863634:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940815.863656:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f41421c3e00/0xa1d8aa9164aa2f04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226406 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940815.863679:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940815.863832:0:12520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036083840 00000100:00100000:2.0:1788940815.863837:0:12520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036083840 00000100:00100000:2.0:1788940815.863872:0:12520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 72 00000100:00100000:2.0:1788940815.863899:0:12520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fbe6afa-4201-4af1-bbe2-c715064eeb39+5:2357:x1875840036083840:12345-192.168.202.17@tcp:9:umount.0 00000020:00000080:2.0:1788940815.863931:0:12520:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2fc8 00000100:00080000:2.0:1788940815.863943:0:12520:0:(import.c:65:import_set_state_nolock()) ffff8f41184d2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940815.864003:0:12520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788940815.865534:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f53b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd220973-afce-4e0b-b310-f94af7a18e79+10:2361:x1875840036083712:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 1909us (6222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940815.865549:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 21 00000100:00100000:2.0:1788940815.865642:0:12520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9fbe6afa-4201-4af1-bbe2-c715064eeb39+2:2357:x1875840036083840:12345-192.168.202.17@tcp:9:umount.0 Request processed in 1745us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940815.865654:0:12520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 72 00010000:00010000:2.0:1788940815.865680:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940815.870500:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940815.870746:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036084224 00000100:00100000:2.0:1788940815.870760:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036084224 00000100:00100000:2.0:1788940815.870920:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 73 00000100:00100000:2.0:1788940815.870933:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2357:x1875840036084224:12345-192.168.202.17@tcp:9:umount.0 00000020:00000080:2.0:1788940815.870977:0:8426:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa3230 00000020:00010000:2.0:1788940815.870988:0:8426:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f41109bb000: total 0 00000100:00080000:2.0:1788940815.871004:0:8426:0:(import.c:65:import_set_state_nolock()) ffff8f4108742800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940815.871067:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:0.0:1788940815.871448:0:5821:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f41109bb000: total 0 00010000:00010000:0.0:1788940815.871493:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f41109bb000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788940815.871566:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cae6ea5/0xa1d8aa9164aa35cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265db expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.871607:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000702654e6/0xa1d8aa9164aa3c5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267a2 expref: 5 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.871624:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f41109bb000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788940815.871636:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940815.871638:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940815.871640:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940815.872611:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fbe6afa-4201-4af1-bbe2-c715064eeb39+2:2357:x1875840036084224:12345-192.168.202.17@tcp:9:umount.0 Request processed in 1672us (2119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940815.872626:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 73 00000100:00100000:3.0:1788940815.884132:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940815.884600:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036085248 00000100:00100000:2.0:1788940815.884614:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036085248 00000100:00100000:2.0:1788940815.884680:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 239 00000100:00100000:2.0:1788940815.884692:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+22:2357:x1875840036085248:12345-192.168.202.17@tcp:39:umount.0 00000020:00000080:2.0:1788940815.884740:0:5833:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2c64 00000020:00010000:2.0:1788940815.884758:0:5833:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f413a6c8800: total 0 00000100:00080000:2.0:1788940815.884765:0:5833:0:(import.c:65:import_set_state_nolock()) ffff8f413a6cf000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940815.884797:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1788940815.885403:0:7620:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f413a6c8800: total 0 00010000:00010000:0.0:1788940815.885462:0:7620:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f413a6c8800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788940815.885504:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9fd00) 00010000:00010000:0.0:1788940815.885508:0:7620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940815.885519:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234400/0xa1d8aa9164aa2f4a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22641b expref: 22 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.885547:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:0.0:1788940815.885557:0:7620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788940815.885563:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136235e00/0xa1d8aa9164aa391b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2266c9 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.885581:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:0.0:1788940815.885584:0:7620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940815.885588:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100031800/0xa1d8aa9164aa3b3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226755 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.885603:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8f4112cbfa00) 00010000:00010000:0.0:1788940815.885606:0:7620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788940815.885610:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa363c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265f7 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.885630:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:0.0:1788940815.885633:0:7620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940815.885637:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050a00/0xa1d8aa9164aa358d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265c6 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.885651:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:0.0:1788940815.885654:0:7620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788940815.885658:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5200/0xa1d8aa9164aa328b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226502 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.885673:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f410ad9f900) 00010000:00010000:0.0:1788940815.885675:0:7620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940815.885679:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4136234a00/0xa1d8aa9164aa2f2e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226414 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.885709:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:0.0:1788940815.885712:0:7620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788940815.885716:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142051c00/0xa1d8aa9164aa35b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265d4 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.885729:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8f410ad9f800) 00010000:00010000:0.0:1788940815.885732:0:7620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940815.885735:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4142050c00/0xa1d8aa9164aa34ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22658e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.885749:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:0.0:1788940815.885751:0:7620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940815.885755:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4100030800/0xa1d8aa9164aa3c1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22678d expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.885768:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8f41054d7100) 00010000:00010000:0.0:1788940815.885770:0:7620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788940815.885774:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa2f9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226430 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.885790:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:0.0:1788940815.885792:0:7620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940815.885797:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36800/0xa1d8aa9164aa3620 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2265f0 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.885809:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8f4112cbfc00) 00010000:00010000:0.0:1788940815.885811:0:7620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788940815.885822:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42a00/0xa1d8aa9164aa3c47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22679b expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940815.885837:0:7620:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f413a6c8800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788940815.885864:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940815.885867:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940815.885869:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940815.886784:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fbe6afa-4201-4af1-bbe2-c715064eeb39+7:2357:x1875840036085248:12345-192.168.202.17@tcp:39:umount.0 Request processed in 2087us (2662us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788940815.886798:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 239 00010000:00010000:1.0:1788940815.947903:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940816.978893:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788940817.000212:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:0.0:1788940817.000247:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000001:00080000:0.0:1788940817.000256:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788940817.000265:0:5855:0:(genops.c:885:class_export_put()) final put ffff8f413a6c8800/9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000020:00000080:3.0:1788940817.000422:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413a6c8800/9fbe6afa-4201-4af1-bbe2-c715064eeb39 for lustre-MDT0000 00000020:00000080:3.0:1788940817.000511:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f413a6cf000 for lustre-MDT0000 00000001:00100000:2.0:1788940817.492862:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000020:00000080:2.0:1788940817.492874:0:6697:0:(genops.c:885:class_export_put()) final put ffff8f41109bb000/9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000020:00000080:0.0:1788940817.492960:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f41109bb000/9fbe6afa-4201-4af1-bbe2-c715064eeb39 for lustre-OST0000 00000020:00000080:0.0:1788940817.493038:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f4108742800 for lustre-OST0000 00000100:00100000:2.0:1788940817.939456:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940817.942820:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036085376 00000100:00100000:0.0:1788940817.942854:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036085376 00000100:00100000:0.0:1788940817.943074:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 22 00000100:00100000:0.0:1788940817.943087:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd220973-afce-4e0b-b310-f94af7a18e79+10:2359:x1875840036085376:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940817.943111:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940817.943139:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa2d36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226350 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940817.943160:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940817.943270:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd220973-afce-4e0b-b310-f94af7a18e79+9:2359:x1875840036085376:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 185us (3828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940817.944557:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 22 00000100:00100000:0.0:1788940817.949961:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940817.950023:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940817.950061:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036085504 00000100:00100000:2.0:1788940817.950083:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036085632 00000100:00100000:0.0:1788940817.950084:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036085504 00000100:00100000:2.0:1788940817.950087:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036085632 00000100:00100000:2.0:1788940817.950161:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 23 00000100:00100000:2.0:1788940817.950172:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41080e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd220973-afce-4e0b-b310-f94af7a18e79+10:2358:x1875840036085632:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940817.950211:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940817.950237:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f41073d5c00/0xa1d8aa9164aa2efd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2263ff expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940817.950258:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940817.950344:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41080e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd220973-afce-4e0b-b310-f94af7a18e79+9:2358:x1875840036085632:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 157us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940817.950352:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 23 00000100:00100000:2.0:1788940817.950374:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 24 00000100:00100000:2.0:1788940817.950380:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a05ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd220973-afce-4e0b-b310-f94af7a18e79+8:2358:x1875840036085504:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940817.950389:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940817.950398:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc6200/0xa1d8aa9164aa2d3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22637a expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940817.950407:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940817.950429:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a05ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd220973-afce-4e0b-b310-f94af7a18e79+7:2358:x1875840036085504:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 49us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940817.950446:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 24 00000100:00100000:0.0:1788940817.957782:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940817.957863:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036085888 00000100:00100000:1.0:1788940817.957877:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036085888 00000100:00100000:1.0:1788940817.957955:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 240 00000100:00100000:1.0:1788940817.957966:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+6:2357:x1875840036085888:12345-192.168.202.17@tcp:39:umount.0 00000020:00000080:1.0:1788940817.958031:0:5835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2d4b 00000020:00010000:1.0:1788940817.958041:0:5835:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f413f183800: total 0 00000100:00080000:1.0:1788940817.958047:0:5835:0:(import.c:65:import_set_state_nolock()) ffff8f413f185800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788940817.958076:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1788940817.958520:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6703b9d8-8e00-4d48-b07a-3d1d34afc200+5:2357:x1875840036085888:12345-192.168.202.17@tcp:39:umount.0 Request processed in 554us (749us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788940817.958529:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 240 00000020:00010000:1.0:1788940817.958555:0:5821:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f413f183800: total 0 00010000:00010000:1.0:1788940817.958725:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f413f183800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788940817.958766:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4112cbfe00) 00010000:00010000:1.0:1788940817.958770:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940817.958779:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d4600/0xa1d8aa9164aa3c6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267a9 expref: 4 pid: 7198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940817.958808:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f413f183800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788940817.958817:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940817.958820:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940817.958822:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940817.959168:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940817.976828:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940817.977410:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036086144 00000100:00100000:1.0:1788940817.977427:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036086144 00000100:00100000:1.0:1788940817.977506:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 312 00000100:00100000:1.0:1788940817.977519:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+7:2357:x1875840036086144:12345-192.168.202.17@tcp:251:umount.0 00000020:00000080:1.0:1788940817.977607:0:5827:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2c41 00000020:00010000:1.0:1788940817.977639:0:5827:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f413a724000: total 0 00000100:00080000:1.0:1788940817.977646:0:5827:0:(import.c:65:import_set_state_nolock()) ffff8f413a723000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788940817.977741:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd220973-afce-4e0b-b310-f94af7a18e79+3:2357:x1875840036086144:12345-192.168.202.17@tcp:251:umount.0 Request processed in 223us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940817.977750:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 312 00000020:00010000:1.0:1788940817.977789:0:7620:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f413a724000: total 0 00010000:00010000:1.0:1788940817.977794:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940817.977844:0:7620:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f413a724000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788940817.977889:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142051e00/0xa1d8aa9164aa2cf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226342 expref: 2 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940817.977910:0:7620:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f413a724000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788940817.977921:0:7620:0:(genops.c:885:class_export_put()) final put ffff8f413a724000/cd220973-afce-4e0b-b310-f94af7a18e79 00010000:00010000:1.0:1788940817.977935:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940817.977937:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940817.977938:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788940817.977950:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413a724000/cd220973-afce-4e0b-b310-f94af7a18e79 for MGS 00000020:00000080:1.0:1788940817.978007:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f413a723000 for MGS 00010000:00010000:3.0:1788940817.994382:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788940818.011268:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000020:00000080:0.0:1788940818.011279:0:7633:0:(genops.c:885:class_export_put()) final put ffff8f41184d7000/9fbe6afa-4201-4af1-bbe2-c715064eeb39 00000020:00000080:3.0:1788940818.011369:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f41184d7000/9fbe6afa-4201-4af1-bbe2-c715064eeb39 for lustre-OST0001 00000020:00000080:3.0:1788940818.011438:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f41184d2000 for lustre-OST0001 00000100:00100000:3.0:1788940818.440683:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068573824:0@lo:400:kworker.0 00000100:00100000:1.0:1788940818.440715:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068573952:0@lo:400:kworker.0 00000100:00100000:0.0:1788940818.440951:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068574080:0@lo:400:kworker.0 00000100:00100000:1.0:1788940818.441321:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940818.441387:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068573952 00000100:00100000:2.0:1788940818.441400:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068573952 00000100:00100000:1.0:1788940818.441406:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068574464:0@lo:400:kworker.0 00000100:00100000:1.0:1788940818.441444:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940818.441471:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788940818.441486:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068573952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940818.441502:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068574208:0@lo:400:kworker.0 00000100:00100000:2.0:1788940818.441560:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068573952:12345-0@lo:400:kworker.0 Request processed in 77us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940818.441568:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788940818.441632:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a05ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068573952:0@lo:400:kworker.0 00000100:00100000:1.0:1788940818.441641:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940818.441667:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940818.441675:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068574336:0@lo:400:kworker.0 00000100:00100000:2.0:1788940818.441682:0:12520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068574464 00000100:00100000:2.0:1788940818.441687:0:12520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068574464 00000100:00100000:1.0:1788940818.441703:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940818.441736:0:12520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068574208 00000100:00100000:2.0:1788940818.441739:0:12520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068574208 00000100:00100000:1.0:1788940818.441749:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068574336 00000100:00100000:1.0:1788940818.441764:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068574336 00000100:00100000:2.0:1788940818.441765:0:12520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788940818.441775:0:12520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068574464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940818.441808:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788940818.441817:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068574336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940818.441823:0:12520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068574464:12345-0@lo:400:kworker.0 Request processed in 48us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940818.441832:0:12520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788940818.441846:0:12520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788940818.441854:0:12520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068574208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940818.441865:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068574336:12345-0@lo:400:kworker.0 Request processed in 49us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940818.441874:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788940818.441891:0:12520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068574208:12345-0@lo:400:kworker.0 Request processed in 37us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940818.441899:0:12520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788940818.441910:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068574336:0@lo:400:kworker.0 00000100:00100000:1.0:1788940818.441924:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068574208:0@lo:400:kworker.0 00000100:00100000:2.0:1788940818.441945:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068574464:0@lo:400:kworker.0 00000100:00080000:1.0:1788940818.441959:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940818.441982:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940818.441984:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940818.443098:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940818.443523:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068573824 00000100:00100000:1.0:1788940818.443534:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068573824 00000100:00100000:1.0:1788940818.443595:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788940818.443605:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4110f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068573824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940818.443675:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4110f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068573824:12345-0@lo:400:kworker.0 Request processed in 72us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940818.443684:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788940818.443754:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940818.443912:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068573824:0@lo:400:kworker.0 00000100:00100000:1.0:1788940818.444480:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068574080 00000100:00100000:1.0:1788940818.444488:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068574080 00000100:00100000:1.0:1788940818.444554:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788940818.444563:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068574080:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788940818.444568:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940818.444629:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068574080:12345-0@lo:400:kworker.0 Request processed in 67us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940818.444636:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788940818.444700:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068574080:0@lo:400:kworker.0 00000100:00100000:3.0:1788940818.953555:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940818.953591:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068574592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940818.953919:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940818.967401:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068574592 00000100:00100000:2.0:1788940818.967458:0:6675:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068574592 00000100:00100000:2.0:1788940818.967541:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788940818.967554:0:6675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068574592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788940818.967609:0:6675:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940818.967851:0:6675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068574592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 298us (13931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940818.967859:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788940818.967949:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068574592:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940819.020029:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788940819.947285:0:13017:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788940819.967404:0:13017:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788940819.967480:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.967503:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.967512:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.967521:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.967545:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788940819.967552:0:13017:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788940819.967584:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940819.967590:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788940819.967598:0:13017:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788940819.967635:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8f41414f8000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788940819.967816:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940819.967824:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940819.967836:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37800 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:1.0:1788940819.967839:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940819.967847:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940819.967852:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940819.967856:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940819.967857:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788940819.967859:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788940819.967899:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940819.967903:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940819.967927:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940819.967932:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4113b37800/0xa1d8aa9164aa2cc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2ccd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940819.967942:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940819.967944:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940819.967946:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940819.968033:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940819.968053:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068574848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940819.968142:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940819.968336:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068574848 00000100:00100000:1.0:1788940819.968346:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068574848 00000100:00100000:1.0:1788940819.968412:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788940819.968424:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+19:3302:x1875840068574848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940819.968451:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940819.968469:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4113b37200/0xa1d8aa9164aa2ccd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa2cc6 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940819.968483:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940819.968530:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:3302:x1875840068574848:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940819.968538:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788940819.968581:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068574848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940819.969973:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875840068574720:0@lo:39:umount.0 00000100:00100000:2.0:1788940819.970048:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940819.970486:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068574720 00000100:00100000:1.0:1788940819.970497:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068574720 00000100:00100000:1.0:1788940819.970587:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788940819.970598:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875840068574720:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788940819.970637:0:5835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2a50 00000100:00080000:1.0:1788940819.970647:0:5835:0:(import.c:65:import_set_state_nolock()) ffff8f411149c800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788940819.970753:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3300:x1875840068574720:12345-0@lo:39:umount.0 Request processed in 157us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940819.970759:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1788940819.970769:0:5835:0:(genops.c:885:class_export_put()) final put ffff8f41361f2000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1788940819.970830:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f41414f8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788940819.970842:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875840068574720:0@lo:39:umount.0 00010000:00010000:0.0:1788940819.970975:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940819.970995:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940819.970999:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788940819.971005:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788940819.971992:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f41361f2000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1788940819.972580:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.972598:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.972608:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.972617:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.972665:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940819.972672:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.972677:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.972681:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.972684:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940819.972790:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940819.972797:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940819.972802:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37000 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:3.0:1788940819.972806:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940819.972813:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940819.972818:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940819.972822:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788940819.972824:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788940819.973070:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940819.973078:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940819.973113:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940819.973122:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa2cd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2cdb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940819.973138:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940819.973141:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940819.973147:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051000 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:3.0:1788940819.973158:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940819.973164:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940819.973170:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940819.973176:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788940819.973177:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:2.0:1788940819.973306:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068574976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940819.973394:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940819.973467:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068574976 00000100:00100000:2.0:1788940819.973476:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068574976 00000100:00100000:2.0:1788940819.973531:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940819.973540:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a038a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:3302:x1875840068574976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940819.973556:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940819.973573:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4136235800/0xa1d8aa9164aa2cdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa2cd4 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940819.973587:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940819.973624:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a038a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:3302:x1875840068574976:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940819.973632:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788940819.973673:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a5ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068574976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940819.973760:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940819.973767:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940819.973797:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940819.973808:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940819.973810:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940819.973812:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940819.973825:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940819.973835:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068575104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940819.973869:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788940819.974391:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788940819.974402:0:13017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4142051000/0xa1d8aa9164aa2bfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2c02 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940819.974420:0:13017:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788940819.974430:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974438:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974444:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974450:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974467:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940819.974473:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7600/0xa1d8aa9164aa29af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974482:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7600/0xa1d8aa9164aa29af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974488:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7600/0xa1d8aa9164aa29af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974495:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7600/0xa1d8aa9164aa29af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974526:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788940819.974531:0:13017:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788940819.974536:0:13017:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1788940819.974575:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940819.974581:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974589:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136234800 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:0.0:1788940819.974592:0:7620:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974601:0:7620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940819.974609:0:7620:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940819.974615:0:7620:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788940819.974617:0:7620:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788940819.974619:0:7620:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788940819.974642:0:7620:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974649:0:7620:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940819.974664:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974671:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4136234800/0xa1d8aa9164aa2eef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2ef6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974693:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940819.974696:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7600/0xa1d8aa9164aa29af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974703:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7600 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:0.0:1788940819.974706:0:7620:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7600/0xa1d8aa9164aa29af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974714:0:7620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7600/0xa1d8aa9164aa29af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940819.974721:0:7620:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7600/0xa1d8aa9164aa29af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940819.974727:0:7620:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788940819.974729:0:7620:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788940819.974731:0:7620:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788940819.974745:0:7620:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7600/0xa1d8aa9164aa29af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974751:0:7620:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940819.974762:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7600/0xa1d8aa9164aa29af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974768:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7600/0xa1d8aa9164aa29af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa29b6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940819.974780:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940819.974782:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940819.974791:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788940819.974807:0:13017:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788940819.974812:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788940819.974818:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940819.974825:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/8 00000020:00080000:0.0:1788940819.974831:0:13017:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8f413f186000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788940819.974837:0:13017:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8f4139f96800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788940819.974844:0:13017:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8f413f183800 6703b9d8-8e00-4d48-b07a-3d1d34afc200 192.168.202.17@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788940819.974849:0:13017:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8f41106f3380) has exports, disconnecting them 00000020:00080000:0.0:1788940819.974854:0:13017:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f413f186000), last request at 1788940818 00000020:00000080:0.0:1788940819.974862:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2bc3 00010000:00010000:2.0:1788940819.975323:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940819.975344:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940819.975364:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068575232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940819.975429:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940819.975493:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068575104 00000100:00100000:2.0:1788940819.975502:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068575104 00000100:00100000:2.0:1788940819.975549:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068575232 00000100:00100000:2.0:1788940819.975552:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068575232 00000100:00100000:2.0:1788940819.975576:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940819.975585:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+18:3304:x1875840068575104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940819.975601:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940819.975621:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142051800/0xa1d8aa9164aa2c02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa2bfb expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940819.975638:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940819.975671:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+17:3304:x1875840068575104:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (1801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940819.975679:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940819.975696:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940819.975703:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+16:3303:x1875840068575232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940819.975711:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940819.975721:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f41421c3c00/0xa1d8aa9164aa2ef6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa2eef expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940819.975733:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940819.975759:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:3303:x1875840068575232:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940819.975765:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788940819.975807:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3303:1875840068575232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940819.975840:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788940819.975849:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068575360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940819.975877:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788940819.976029:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f411149c800 for lustre-MDT0000 00010000:00010000:1.0:1788940819.976048:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940819.976113:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3304:1875840068575104:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788940819.976314:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8f413f184000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788940819.976375:0:13017:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f413f186000): rc 0 00000020:00000080:0.0:1788940819.976379:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f413f186000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788940819.976393:0:13017:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f4139f96800), last request at 1788940818 00000020:00000080:0.0:1788940819.976399:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2af8 00000100:00080000:0.0:1788940819.976409:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8f4139f97000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788940819.976423:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788940819.976435:0:13017:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f4139f96800): rc 0 00000020:00000080:0.0:1788940819.976437:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f4139f96800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788940819.976447:0:13017:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa0d5817f7ae0 00000100:00080000:0.0:1788940819.976472:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788940819.976475:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788940819.976491:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788940819.976564:0:13017:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788940819.976585:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8f413f3b6000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788940819.976600:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788940819.976602:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788940819.976620:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788940819.976688:0:13017:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788940819.976698:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8f4002193800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788940819.976746:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8f41106f3380) has no exports 00000100:00100000:3.0:1788940819.976855:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068575488:0@lo:9:umount.0 00000100:00100000:3.0:1788940819.976990:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940819.977019:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068575616:0@lo:9:umount.0 00000100:00100000:3.0:1788940819.977044:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940819.977321:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068575488 00000100:00100000:2.0:1788940819.977328:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068575488 00000100:00100000:2.0:1788940819.977374:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068575616 00000100:00100000:2.0:1788940819.977378:0:8426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068575616 00000100:00100000:2.0:1788940819.977402:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788940819.977411:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875840068575488:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788940819.977443:0:8426:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2b45 00000100:00080000:2.0:1788940819.977452:0:8426:0:(import.c:65:import_set_state_nolock()) ffff8f41113bb800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940819.977495:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788940819.978384:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3300:x1875840068575488:12345-0@lo:9:umount.0 Request processed in 969us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940819.978397:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788940819.978422:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788940819.978433:0:8426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875840068575616:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788940819.978456:0:8426:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2c3a 00000100:00080000:2.0:1788940819.978464:0:8426:0:(import.c:65:import_set_state_nolock()) ffff8f4002196000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940819.978499:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788940819.978749:0:8426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3300:x1875840068575616:12345-0@lo:9:umount.0 Request processed in 319us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940819.978756:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1788940819.978795:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940819.978837:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f413f3b6000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788940819.978845:0:3300:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788940819.978847:0:3300:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788940819.978852:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068575488:0@lo:9:umount.0 00000100:00080000:2.0:1788940819.978900:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f4002193800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788940819.978914:0:3300:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788940819.978915:0:3300:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788940819.978918:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068575616:0@lo:9:umount.0 00000100:00100000:1.0:1788940819.979182:0:7622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068575360 00000100:00100000:1.0:1788940819.979206:0:7622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068575360 00000100:00100000:1.0:1788940819.979266:0:7622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788940819.979274:0:7622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a03b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+15:3302:x1875840068575360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940819.979290:0:7622:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940819.979322:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc7a00/0xa1d8aa9164aa29b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa29af expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940819.979345:0:7622:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940819.979390:0:7622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a03b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04+14:3302:x1875840068575360:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (3512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940819.979396:0:7622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788940819.979426:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940819.979449:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068575360:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788940819.979474:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413f186000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788940819.979529:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4139f96800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788940819.979558:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f413f184000 for lustre-MDT0000 00000020:00000080:1.0:1788940819.979564:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f4139f97000 for lustre-MDT0000 00010000:00010000:0.0:1788940819.981288:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788940820.002827:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8f41106f3380) has no exports 00010000:00010000:3.0:1788940820.040795:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788940820.098933:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2a0a 00000020:00000080:0.0:1788940820.098964:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f41346b4000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788940820.098993:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788940820.099086:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f41346b4000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788940820.099249:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940820.099265:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788940820.099271:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8f41415219c0) has no exports 00000020:00000080:2.0:1788940820.099903:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2a03 00000020:00000080:2.0:1788940820.099914:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f41361f1000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788940820.100003:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940820.100013:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788940820.100016:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f41361f5000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788940820.100019:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8f41361f5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788940820.100034:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788940820.100330:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f41361f1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788940821.064865:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940822.095989:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788940822.142880:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6703b9d8-8e00-4d48-b07a-3d1d34afc200 00000001:00080000:3.0:1788940822.142911:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788940822.142919:0:5855:0:(genops.c:885:class_export_put()) final put ffff8f413f183800/6703b9d8-8e00-4d48-b07a-3d1d34afc200 00000020:00000080:0.0:1788940822.143310:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413f183800/6703b9d8-8e00-4d48-b07a-3d1d34afc200 for lustre-MDT0000 00000020:00000080:0.0:1788940822.143386:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f413f185800 for lustre-MDT0000 00000020:01000000:0.0:1788940822.152623:0:13017:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f410821b300 - data ffff8f4131b8eaf8/ffff8f4111254800 00000020:01000000:0.0:1788940822.152827:0:13017:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f410f5154e0 - data ffff8f411d84d1b0/ffff8f41346f4000 00000001:00000004:0.0:1788940822.161738:0:13017:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1788940822.254281:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788940822.254294:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1788940822.254327:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788940822.254330:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788940822.256546:0:6757:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788940822.256555:0:6757:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1788940822.256570:0:6757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788940822.257839:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788940822.257848:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1788940822.257860:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788940822.257864:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788940822.258361:0:7957:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788940822.258366:0:7957:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788940822.258377:0:7957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788940822.310747:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa29d2 00000020:00000080:1.0:1788940822.310766:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f414151d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788940822.311378:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f414151d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788940822.311842:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa29e7 00000020:00000080:1.0:1788940822.311851:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f414151c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788940822.311904:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788940822.311914:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940822.311953:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788940822.311958:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8f41106f0000) has no exports 00000004:01000000:1.0:1788940822.312151:0:13017:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788940822.312162:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2c25 00000020:00000080:1.0:1788940822.312167:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f413a6cd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788940822.312654:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f414151c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788940822.312816:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788940822.312822:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940822.312831:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788940822.312834:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8f413f41b380) has no exports 00000020:00000080:1.0:1788940822.312843:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2c1e 00000020:00000080:1.0:1788940822.312850:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f4002195000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788940822.312906:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413a6cd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788940822.313726:0:13017:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788940822.313733:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788940822.313739:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788940822.313747:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788940822.313749:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788940822.313798:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940822.313807:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788940822.313819:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2b3e 00000020:00000080:1.0:1788940822.313826:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f41113bf800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788940822.313831:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788940822.313836:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940822.313840:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788940822.313842:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8f414129cd40) has no exports 00000020:00000080:1.0:1788940822.313847:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2b37 00000020:00000080:1.0:1788940822.313850:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f413f3b5800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788940822.314323:0:13017:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788940822.314328:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788940822.314331:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788940822.314334:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788940822.314336:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788940822.314365:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940822.314382:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788940822.314416:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940822.314420:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788940822.314424:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f411149a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940822.314427:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8f411149a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788940822.314434:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788940822.314625:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa29ee 00000020:00000080:1.0:1788940822.314632:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f414151b800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788940822.314636:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788940822.314640:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940822.314643:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788940822.314646:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8f4141524d40) has no exports 00000020:00000080:1.0:1788940822.314668:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940822.314672:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788940822.314675:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa29f5 00000020:00000080:1.0:1788940822.314679:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f414151d000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788940822.314688:0:13017:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f411876b000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788940822.314691:0:13017:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f411876b000 3 00000020:01000004:1.0:1788940822.314694:0:13017:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f411876b000 from lustre-MDT0000 00000020:00000080:1.0:1788940822.314718:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940822.314722:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788940822.314725:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f414151e000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788940822.314727:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8f414151e000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788940822.314735:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788940822.314762:0:13017:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788940822.314766:0:13017:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788940822.314768:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788940822.314771:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940822.314774:0:13017:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788940822.314782:0:13017:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8f411149c000 d726abb2-e4c2-4da6-a0b4-cf7a68b51e04 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788940822.314787:0:13017:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8f41106f19c0) has exports, disconnecting them 00000020:00080000:1.0:1788940822.314792:0:13017:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8f411149c000), last request at 1788940571 00000020:00000080:1.0:1788940822.314817:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2993 00000020:00010000:1.0:1788940822.314822:0:13017:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8f411149c000: total 5 00000100:00080000:1.0:1788940822.314827:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8f411149e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788940822.314851:0:13017:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f411149c000): rc 0 00000020:00080000:1.0:1788940822.314857:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8f41106f19c0) has no exports 00000100:00100000:1.0:1788940822.314923:0:5828:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8f410652ec00:5828] 2 exiting: rc = 0 00000100:00100000:3.0:1788940822.315308:0:5826:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8f410f7f9e00:5826] 0 exiting: rc = 1 00000020:00000080:3.0:1788940822.315352:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4002195000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788940822.315361:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f4002193800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788940822.315367:0:38:0:(genops.c:885:class_export_put()) final put ffff8f413f3b1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788940822.315368:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413f3b1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788940822.315373:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788940822.315435:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f41113bf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788940822.315440:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413f3b5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788940822.315445:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f413f3b6000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788940822.315449:0:38:0:(genops.c:885:class_export_put()) final put ffff8f413f182000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788940822.315451:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413f182000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788940822.315455:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788940822.315528:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f414151b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788940822.315533:0:38:0:(genops.c:885:class_export_put()) final put ffff8f414151a800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788940822.315535:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f414151a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788940822.315539:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788940822.315719:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f414151d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788940822.315842:0:5820:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8f411149c000: total 0 00010000:00010000:2.0:1788940822.315884:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f411149c000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788940822.315919:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4113b37600/0xa1d8aa9164aa2ce9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ce2 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940822.315952:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f41421c3600/0xa1d8aa9164aa2ee8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ee1 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940822.315969:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc6800/0xa1d8aa9164aa2aab lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa2aa4 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940822.316008:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142050000/0xa1d8aa9164aa2c95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa2c8e expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940822.316021:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4142050800/0xa1d8aa9164aa2ca3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa2c9c expref: 5 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940822.316033:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4136234600/0xa1d8aa9164aa2cb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa2caa expref: 4 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940822.316044:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4136235000/0xa1d8aa9164aa2cbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa2cb8 expref: 3 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940822.316058:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f41073d4800/0xa1d8aa9164aa2eda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa1d8aa9164aa2ed3 expref: 2 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940822.316070:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f411149c000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788940822.316085:0:5820:0:(genops.c:885:class_export_put()) final put ffff8f411149c000/d726abb2-e4c2-4da6-a0b4-cf7a68b51e04 00010000:00010000:2.0:1788940822.316110:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940822.316113:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940822.316115:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940822.316153:0:5827:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8f410f7f9000:5827] 1 exiting: rc = 0 00000020:00000080:3.0:1788940822.316276:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f411149c000/d726abb2-e4c2-4da6-a0b4-cf7a68b51e04 for MGS 00000020:00000080:3.0:1788940822.316324:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f411149e000 for MGS 00000100:00100000:1.0:1788940822.317052:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317063:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317069:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317076:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317082:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317089:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317095:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317101:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317109:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317115:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317122:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317129:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317136:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317142:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317148:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317154:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317161:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317167:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317173:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317179:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317679:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317690:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317697:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317704:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317710:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317716:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317724:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317730:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.317750:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318048:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318057:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318063:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318070:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318076:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318082:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318088:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318094:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318100:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318105:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318111:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318117:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318122:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318128:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318133:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318139:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318145:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318151:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318157:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318162:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318167:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318173:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318179:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318615:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318627:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318633:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318639:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318646:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318653:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318659:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318666:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318673:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318680:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318685:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.318700:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788940822.319166:0:13017:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788940822.319170:0:13017:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788940822.320647:0:13017:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f413f375a80 - data ffff8f411db43d80/ffff8f413a6d7400 00000020:01000000:1.0:1788940822.320798:0:13017:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f410f6e1900 - data ffff8f411d8696c0/ffff8f410727ac00 00000020:00000080:1.0:1788940822.321484:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2977 00000020:00000080:1.0:1788940822.321495:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f4102b65000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788940822.321513:0:13017:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f411876b000 from MGS, refs=2 00000020:01000004:1.0:1788940822.321517:0:13017:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f411876b000 2 00000020:01000004:1.0:1788940822.321521:0:13017:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f411876b000 from MGS 00000020:00000080:1.0:1788940822.321546:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940822.321554:0:13017:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788940822.321556:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f4105492800/MGS 00000020:00000080:1.0:1788940822.321559:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4105492800/MGS for MGS 00000020:01000000:1.0:1788940822.321568:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788940822.321640:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788940822.321645:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940822.321652:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788940822.321660:0:13017:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8f414022c000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788940822.321666:0:13017:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8f4141520000) has exports, disconnecting them 00000020:00080000:1.0:1788940822.321672:0:13017:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8f414022c000), last request at 1788940572 00000020:00000080:1.0:1788940822.321678:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2a42 00000020:00080000:1.0:1788940822.321688:0:13017:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f414022c000): rc 0 00000020:00000080:1.0:1788940822.321692:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f414022c000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788940822.322447:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4102b65000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788940822.322460:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f414022c000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788940822.325271:0:13017:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788940822.325295:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940822.325302:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788940822.325312:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788940822.325558:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940822.325581:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788940822.325592:0:13017:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f411876b000 1 00000020:00000080:2.0:1788940822.325601:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2969 00000020:00000080:2.0:1788940822.325613:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f4118710800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788940822.325621:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788940822.325627:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940822.325632:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788940822.325637:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8f41106f4d40) has no exports 00000020:00000080:3.0:1788940822.325837:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f41414f8000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788940822.325853:0:36:0:(genops.c:885:class_export_put()) final put ffff8f41414fb000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788940822.325857:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f41414fb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788940822.325865:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788940822.325966:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4118710800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788940822.339030:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940822.339053:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788940822.339061:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f4105496800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788940822.339067:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4105496800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788940822.339081:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788940822.339314:0:13017:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f4116aa0000 00000020:01000000:2.0:1788940822.339341:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788940822.339346:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940822.339352:0:13017:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788940822.339357:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8f411828b380) has no exports 00000100:00100000:2.0:1788940822.339454:0:5833:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8f4111540a00:5833] 0 exiting: rc = 1 00000100:00100000:2.0:1788940822.339600:0:7198:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8f413f27f000:7198] 3 exiting: rc = 0 00000100:00100000:1.0:1788940822.360514:0:5834:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8f4111540600:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1788940822.360676:0:5835:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8f410726fc00:5835] 2 exiting: rc = 0 00000100:00100000:2.0:1788940822.360809:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360818:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360825:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360831:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360837:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360843:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360850:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360855:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360861:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360868:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360873:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360879:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360885:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360904:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360911:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360917:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360942:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360950:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360956:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360962:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360969:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360976:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360983:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360989:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.360996:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361002:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361008:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361013:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361019:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361025:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361031:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361037:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361042:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361048:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361053:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361059:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361064:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361070:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361076:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361082:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361088:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361093:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361099:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361104:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361110:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361115:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361121:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361126:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361137:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361143:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361149:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361154:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361160:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361166:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361172:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361178:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361215:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361223:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361229:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361236:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361241:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361247:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361252:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.361258:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.367001:0:5836:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8f4111267a00:5836] 0 exiting: rc = 1 00000100:00100000:3.0:1788940822.367228:0:5837:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8f4111267e00:5837] 1 exiting: rc = 0 00000100:00100000:2.0:1788940822.367396:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367406:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367412:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367419:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367426:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367432:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367438:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367446:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367452:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367459:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367466:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367473:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367481:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367487:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367493:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367498:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367504:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367510:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367515:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367533:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367539:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367545:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367552:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367558:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367563:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367569:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367575:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367580:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367587:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367593:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367598:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367603:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367609:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367615:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367620:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367626:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367630:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367637:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367643:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367651:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367656:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367661:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367666:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367671:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367679:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367684:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367691:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367696:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367702:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367708:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367713:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367718:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367724:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367729:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367741:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367747:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367753:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367759:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367764:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367769:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367774:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367779:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367786:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.367791:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.368466:0:5838:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8f410726ee00:5838] 0 exiting: rc = 1 00000100:00100000:3.0:1788940822.368603:0:5839:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8f410726e600:5839] 1 exiting: rc = 0 00000100:00100000:2.0:1788940822.368974:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.368984:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.368990:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.368996:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369003:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369009:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369015:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369021:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369027:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369034:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369040:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369046:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369064:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369073:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369080:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369086:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369093:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369099:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369105:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369112:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369118:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369125:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369133:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369140:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369161:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369180:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369259:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369267:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369273:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369280:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369358:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369366:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369373:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369379:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369387:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369393:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369415:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369423:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369430:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369437:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369444:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369451:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369458:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369464:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369470:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369476:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369482:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369488:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369509:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369517:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369524:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369531:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369538:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369545:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369551:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369559:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369568:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369579:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369586:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369594:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369619:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369626:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369633:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.369641:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.382223:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8f410726e200:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1788940822.382528:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8f410726ec00:5841] 1 exiting: rc = 0 00000100:00100000:3.0:1788940822.382619:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382627:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382633:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382638:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382643:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382649:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382654:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382659:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382665:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382670:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382675:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382680:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382684:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382690:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382695:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382700:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382705:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382710:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382715:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382720:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382726:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382730:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382736:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382741:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382746:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382751:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382756:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382774:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382779:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382784:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382789:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382794:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382799:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382805:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382811:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382816:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382822:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382892:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382898:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382903:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382909:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382915:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382920:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382926:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382942:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382947:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382953:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382958:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382963:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382968:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382973:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382978:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382983:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382988:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382993:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.382998:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.383003:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.383008:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.383013:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.383018:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.383023:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.383027:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.383039:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.383044:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.384217:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8f410726f800:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1788940822.384386:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8f410726e800:5843] 1 exiting: rc = 0 00000100:00100000:3.0:1788940822.384506:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384513:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384519:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384527:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384532:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384538:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384569:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384576:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384582:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384587:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384593:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384599:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384604:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384609:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384615:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384620:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384625:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384629:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384634:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384639:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384644:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384648:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384653:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384658:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384662:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384667:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384673:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384678:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384683:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384688:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384693:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384698:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384702:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384716:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384722:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384726:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384732:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384738:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384744:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384754:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384760:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384765:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384770:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384775:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384780:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384785:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384790:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384795:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384799:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384804:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384809:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384813:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384818:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384823:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384827:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384831:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384836:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384840:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384845:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384887:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384893:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384897:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384903:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.384908:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940822.385592:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8f411866e800:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1788940822.385700:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8f411128ea00:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1788940822.385778:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385783:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385788:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385792:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385801:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385805:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385809:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385813:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385816:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385820:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385824:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385827:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385830:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385834:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385838:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385841:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385845:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385848:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385851:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385854:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385858:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385861:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385864:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385866:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385869:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385872:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385875:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385878:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385881:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385885:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385889:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385892:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385896:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385898:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385902:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385905:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385909:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385912:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385915:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385921:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385924:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385927:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385945:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385950:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385955:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385961:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385967:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385972:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385977:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385982:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385987:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385992:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.385997:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.386002:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.386007:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.386013:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.386017:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.386022:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.386027:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.386032:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.386037:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.386042:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.386048:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.386054:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940822.386972:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8f411866fe00:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1788940822.387860:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8f4140222600:5848] 2 exiting: rc = 0 00000100:00100000:1.0:1788940822.388808:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8f411866f000:5847] 1 exiting: rc = 0 00000100:00100000:3.0:1788940822.389780:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389796:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389805:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389816:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389824:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389832:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389840:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389846:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389854:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389860:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389885:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389893:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389899:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389940:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389951:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389959:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389965:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389972:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389978:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389984:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389991:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.389998:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390005:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390011:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390018:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390024:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390032:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390038:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390043:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390050:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390056:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390063:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390070:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390076:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390083:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390089:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390095:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390117:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390125:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390131:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390137:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390143:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390150:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390157:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390163:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390177:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390214:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390223:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390229:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390236:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390243:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390251:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390257:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390263:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390269:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390275:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390281:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390419:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390426:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390431:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390438:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390444:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390450:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940822.390455:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788940822.395523:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940822.395543:0:13017:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788940822.395551:0:13017:0:(genops.c:885:class_export_put()) final put ffff8f4118281000/MDS_uuid 00000020:00000080:3.0:1788940822.395558:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4118281000/MDS_uuid for MDS 00000020:01000000:3.0:1788940822.395577:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788940822.395782:0:13017:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:2.0:1788940822.623426:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788940822.623438:0:6697:0:(genops.c:885:class_export_put()) final put ffff8f41113bc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788940822.623601:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f41113bc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788940822.623655:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f41113bb800 for lustre-OST0000 00010000:00010000:2.0:1788940823.114113:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788940823.136696:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788940823.136708:0:7633:0:(genops.c:885:class_export_put()) final put ffff8f4002194000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788940823.136919:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4002194000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788940823.136978:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f4002196000 for lustre-OST0001 00000100:00100000:2.0:1788940823.560579:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068575872:0@lo:400:kworker.0 00000400:00000100:2.0:1788940823.560637:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840068575872 offset 0 length 224: 4 00000100:00100000:1.0:1788940823.560774:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068575744:0@lo:400:kworker.0 00000400:00000100:1.0:1788940823.560801:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875840068575744 offset 0 length 224: 4 00000100:00100000:2.0:1788940823.560850:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940823.560857:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068576000:0@lo:400:kworker.0 00000400:00000100:2.0:1788940823.560876:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840068576000 offset 0 length 224: 4 00010000:00010000:2.0:1788940824.136574:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788940825.111387:0:13171:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788940825.128575:0:13171:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788940825.128631:0:13171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940825.128647:0:13171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940825.128655:0:13171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940825.128676:0:13171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940825.128697:0:13171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788940825.128701:0:13171:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788940825.128727:0:13171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940825.128737:0:13171:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f40039c4a80 x1875840068575872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940839 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788940825.128746:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940825.128756:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940825.128762:0:13171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788940825.128767:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050200 already unused, calling callback (ffffffffc1aa9c20) 00000100:00080000:2.0:1788940825.128770:0:13171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 10000000:00010000:0.0:1788940825.128773:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940825.128783:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940825.128791:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788940825.128798:0:13171:0:(import.c:65:import_set_state_nolock()) ffff8f413f3b7000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:0.0:1788940825.128822:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788940825.128825:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788940825.128828:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788940825.128864:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940825.128870:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788940825.128882:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068575872:0@lo:400:kworker.0 00010000:00010000:0.0:1788940825.128927:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940825.128935:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4142050200/0xa1d8aa9164aa2caa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa1d8aa9164aa2cb1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940825.128947:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940825.128949:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940825.128951:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940825.129121:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940825.129135:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068576256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940825.129154:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1875840068576128:0@lo:39:umount.0 00000400:00000100:3.0:1788940825.129220:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840068576128 offset 0 length 224: 4 00000100:00100000:1.0:1788940825.129336:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940825.129374:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068576256 00000100:00100000:2.0:1788940825.129382:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068576256 00000100:00100000:2.0:1788940825.129424:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788940825.129432:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3302:x1875840068576256:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788940825.129439:0:5817:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788940825 with bad export cookie 11662258776511752595 00000100:00100000:2.0:1788940825.135368:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3302:x1875840068576256:12345-0@lo:103:ldlm_bl.0 Request processed in 5926us (6022us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788940825.135384:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788940825.135412:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.117@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788940825.135418:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f4118287800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788940825.135423:0:3302:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.117@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788940825.143639:0:3302:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.117@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788940825.143647:0:3302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788940825.143658:0:3302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f40039c5500 x1875840068575744/t0(0) o400->MGC192.168.202.117@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788940839 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940825.143676:0:3302:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f40039c7100 x1875840068576256/t0(0) o103->MGC192.168.202.117@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788940841 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788940825.143685:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788940825.143687:0:3302:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788940825.143689:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788940825.143693:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8f4118287800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940825.143698:0:3302:0:(import.c:545:import_select_connection()) MGC192.168.202.117@tcp: connect to NID 0@lo last attempt 212 00000100:00080000:1.0:1788940825.143714:0:3302:0:(import.c:666:import_select_connection()) MGC192.168.202.117@tcp: import ffff8f4118287800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:1.0:1788940825.143748:0:3302:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4002db5f80 x1875840068576384/t0(0) o250->MGC192.168.202.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940825.143813:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068575744:0@lo:400:kworker.0 00000100:00100000:1.0:1788940825.143851:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3302:1875840068576256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940825.144148:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3300:1875840068576384:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1788940825.144542:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875840068576384 offset 0 length 520: 4 00010000:00010000:2.0:1788940825.160509:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940826.184334:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940827.208328:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940828.233472:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940828.685461:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d726abb2-e4c2-4da6-a0b4-cf7a68b51e04->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788940828.685472:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) d726abb2-e4c2-4da6-a0b4-cf7a68b51e04->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788940828.685552:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788940828.685580:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068576512:0@lo:400:kworker.0 00000400:00000100:0.0:1788940828.686145:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840068576512 offset 0 length 224: 4 00010000:00010000:2.0:1788940829.256364:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940830.281504:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940830.728687:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d726abb2-e4c2-4da6-a0b4-cf7a68b51e04->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788940830.728702:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) d726abb2-e4c2-4da6-a0b4-cf7a68b51e04->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788940830.728880:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068576640:0@lo:400:kworker.0 00000400:00000100:1.0:1788940830.728947:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840068576640 offset 0 length 224: 4 00010000:00010000:0.0:1788940831.304666:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940832.329213:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940833.353039:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940834.377772:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940835.336725:0:3300:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940825/real 1788940825] req@ffff8f4002db5f80 x1875840068576384/t0(0) o250->MGC192.168.202.117@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788940835 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940835.336764:0:3300:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f4002db5f80 x1875840068576384/t0(0) o250->MGC192.168.202.117@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788940835 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940835.336775:0:3300:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940825/real 1788940825] req@ffff8f413a039c00 x1875840068576128/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788940835 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940835.336786:0:3300:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f413a039c00 x1875840068576128/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788940835 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788940835.336804:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f4118287800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940835.336861:0:3300:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788940835.336865:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3300:1875840068576384:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1788940835.336872:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f413f3b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788940835.336889:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1875840068576128:0@lo:39:umount.0 00000100:00080000:3.0:1788940835.336974:0:13171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788940835.336978:0:13171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788940835.336982:0:13171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788940835.337855:0:13171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2cbf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940835.337887:0:13171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2cbf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940835.337895:0:13171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2cbf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940835.337901:0:13171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2cbf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940835.337926:0:13171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940835.337934:0:13171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ee8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940835.337940:0:13171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2ee8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940835.337947:0:13171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2ee8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940835.337953:0:13171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2ee8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940835.337974:0:13171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788940835.337978:0:13171:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788940835.337998:0:13171:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788940835.338002:0:13171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788940835.338006:0:13171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940835.338011:0:13171:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788940835.338016:0:13171:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8f413f41cd40) has no exports 00000020:00080000:3.0:1788940835.338045:0:13171:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8f413f41cd40) has no exports 00000020:01000000:3.0:1788940835.339722:0:13171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f413f375360 - data ffff8f411db435e8/ffff8f41352b0000 00010000:00010000:1.0:1788940835.339941:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940835.339949:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2cbf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940835.339960:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235200 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:1.0:1788940835.339965:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2cbf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940835.339975:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa1d8aa9164aa2cbf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940835.339982:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa1d8aa9164aa2cbf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940835.339988:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940835.339990:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788940835.339993:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788940835.340009:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f4118287800 00010000:00010000:1.0:1788940835.340013:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa1d8aa9164aa2cbf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940835.340020:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4136235200/0xa1d8aa9164aa2cb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa1d8aa9164aa2cbf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940835.340050:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940835.340054:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2ee8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940835.340060:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41421c2000 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:1.0:1788940835.340063:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2ee8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940835.340069:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa1d8aa9164aa2ee8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940835.340076:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa1d8aa9164aa2ee8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940835.340080:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788940835.340082:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788940835.340084:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788940835.340090:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f4118287800 00010000:00010000:1.0:1788940835.340093:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa1d8aa9164aa2ee8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940835.340098:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f41421c2000/0xa1d8aa9164aa2ee1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa1d8aa9164aa2ee8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940835.340107:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940835.340108:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940835.340110:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940835.340566:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d726abb2-e4c2-4da6-a0b4-cf7a68b51e04->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788940835.340572:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788940835.340576:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f4118287800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940835.340583:0:38:0:(import.c:545:import_select_connection()) MGC192.168.202.117@tcp: connect to NID 0@lo last attempt 466 00000100:00080000:0.0:1788940835.340596:0:38:0:(import.c:630:import_select_connection()) MGC192.168.202.117@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788940835.340608:0:38:0:(import.c:666:import_select_connection()) MGC192.168.202.117@tcp: import ffff8f4118287800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:0.0:1788940835.340640:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f40039c5f80 x1875840068576768/t0(0) o250->MGC192.168.202.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940835.340715:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068576896:0@lo:400:kworker.0 00000400:00000100:0.0:1788940835.340766:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840068576896 offset 0 length 224: 4 00000100:00100000:1.0:1788940835.340885:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3300:1875840068576768:0@lo:250:kworker.0 00000400:00000100:1.0:1788940835.340908:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875840068576768 offset 0 length 520: 4 00010000:00010000:2.0:1788940835.341455:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788940835.342907:0:13171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f4118555e40 - data ffff8f4131b90798/ffff8f413a7af000 00100000:10000000:3.0:1788940835.352047:0:13171:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00010000:00010000:2.0:1788940835.403357:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788940835.409586:0:13171:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2ac7 00000020:00000080:0.0:1788940835.409599:0:13171:0:(genops.c:885:class_export_put()) final put ffff8f413f414000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788940835.409620:0:13171:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f410f4f2000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788940835.409624:0:13171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f410f4f2000 2 00000020:01000004:0.0:1788940835.409627:0:13171:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f410f4f2000 from lustre-OST0000 00000020:00000080:0.0:1788940835.409653:0:13171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940835.409674:0:13171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788940835.409677:0:13171:0:(genops.c:885:class_export_put()) final put ffff8f413f416800/lustre-OST0000_UUID 00000020:00000080:0.0:1788940835.409680:0:13171:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413f416800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788940835.409686:0:13171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788940835.409725:0:13171:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788940835.409730:0:13171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788940835.409733:0:13171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940835.409738:0:13171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788940835.409754:0:13171:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8f4139f90000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788940835.409760:0:13171:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8f4134e599c0) has exports, disconnecting them 00000020:00080000:0.0:1788940835.409765:0:13171:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8f4139f90000), last request at 1788940593 00000020:00000080:0.0:1788940835.409769:0:13171:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2af1 00000020:00080000:0.0:1788940835.409778:0:13171:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f4139f90000): rc 0 00000020:00000080:0.0:1788940835.409785:0:13171:0:(genops.c:885:class_export_put()) final put ffff8f4139f90000/lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788940835.410475:0:13171:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788940835.410481:0:13171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788940835.410485:0:13171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788940835.410490:0:13171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788940835.410624:0:13171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940835.410630:0:13171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788940835.410634:0:13171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f410f4f2000 1 00000020:00000080:1.0:1788940835.410638:0:13171:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2a81 00000020:00000080:1.0:1788940835.410643:0:13171:0:(genops.c:885:class_export_put()) final put ffff8f41346b2800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788940835.410647:0:13171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788940835.410651:0:13171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940835.410654:0:13171:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788940835.410657:0:13171:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8f4141523380) has no exports 00000020:00000080:2.0:1788940835.410904:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413f414000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788940835.410918:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4139f90000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788940835.410923:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f413f3b7000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788940835.410928:0:38:0:(genops.c:885:class_export_put()) final put ffff8f413f3b2000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788940835.410930:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413f3b2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788940835.410934:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788940835.410983:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f41346b2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788940835.442145:0:13171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940835.442169:0:13171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788940835.442174:0:13171:0:(genops.c:885:class_export_put()) final put ffff8f41414fa000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788940835.442178:0:13171:0:(genops.c:844:class_export_destroy()) destroying export ffff8f41414fa000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788940835.442213:0:13171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788940835.442360:0:13171:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f41414fe800 00000020:02000400:1.0:1788940835.442412:0:13171:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788940836.424897:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940837.448525:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940838.477395:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788940838.901504:0:13324:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788940838.929416:0:13324:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788940838.929500:0:13324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2c95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940838.929531:0:13324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2c95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940838.929539:0:13324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2c95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940838.929546:0:13324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2c95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940838.929795:0:13324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788940838.929802:0:13324:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788940838.930057:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788940838.930069:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f40039c4000 x1875840068576000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940839 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940838.930095:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f413a039500 x1875840068576512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940844 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940838.930112:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f40039c6d80 x1875840068576640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940846 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940838.930121:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f40039c5880 x1875840068576896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940851 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940838.930146:0:13324:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788940838.930224:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068576512:0@lo:400:kworker.0 00000100:00100000:1.0:1788940838.930266:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068576896:0@lo:400:kworker.0 00000100:00080000:1.0:1788940838.930286:0:13324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788940838.930318:0:13324:0:(import.c:65:import_set_state_nolock()) ffff8f413a744000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788940838.930346:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1875840068577024:0@lo:39:umount.0 00000400:00000100:1.0:1788940838.930395:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875840068577024 offset 0 length 224: 4 00010000:00010000:3.0:1788940838.930678:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940838.930687:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2c95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940838.930695:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7e00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:3.0:1788940838.930699:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2c95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940838.930708:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa1d8aa9164aa2c95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940838.930727:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa1d8aa9164aa2c95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940838.930733:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788940838.930735:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788940838.930738:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788940838.930750:0:5820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f4118287800 00010000:00010000:3.0:1788940838.930754:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa1d8aa9164aa2c95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940838.930761:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa2c8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa1d8aa9164aa2c95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940838.930782:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940838.930793:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940838.930795:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940838.930974:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068576640:0@lo:400:kworker.0 00000100:00100000:0.0:1788940838.930983:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068576000:0@lo:400:kworker.0 00010000:00010000:3.0:1788940839.496399:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940840.459971:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d726abb2-e4c2-4da6-a0b4-cf7a68b51e04->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788940840.459982:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) d726abb2-e4c2-4da6-a0b4-cf7a68b51e04->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788940840.522018:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940841.544542:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940842.568915:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940843.592636:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940844.620528:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940845.576530:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d726abb2-e4c2-4da6-a0b4-cf7a68b51e04->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788940845.576542:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) d726abb2-e4c2-4da6-a0b4-cf7a68b51e04->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788940845.640500:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940846.664719:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940847.690526:0:7620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940848.136553:0:3300:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940838/real 1788940838] req@ffff8f4002db5880 x1875840068577024/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788940848 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940848.136584:0:3300:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f4002db5880 x1875840068577024/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788940848 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788940848.136613:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f413a744000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788940848.136628:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1875840068577024:0@lo:39:umount.0 00000100:00080000:3.0:1788940848.137282:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788940848.137288:0:13324:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788940848.137293:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788940848.138411:0:13324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2ca3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940848.138426:0:13324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2ca3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940848.138432:0:13324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2ca3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940848.138440:0:13324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2ca3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940848.138457:0:13324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940848.138465:0:13324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa2eda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940848.138472:0:13324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa2eda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940848.138478:0:13324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2eda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940848.138502:0:13324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa1d8aa9164aa2eda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940848.138512:0:13324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788940848.138517:0:13324:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788940848.138537:0:13324:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788940848.138541:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788940848.138546:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940848.138551:0:13324:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788940848.138556:0:13324:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8f413f4199c0) has no exports 00000020:00080000:3.0:1788940848.138581:0:13324:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8f413f4199c0) has no exports 00010000:00010000:1.0:1788940848.139148:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940848.139157:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2ca3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.139165:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37a00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:1.0:1788940848.139168:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2ca3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.139177:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa1d8aa9164aa2ca3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940848.139212:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa1d8aa9164aa2ca3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940848.139218:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940848.139220:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788940848.139222:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788940848.139235:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f4118287800 00010000:00010000:1.0:1788940848.139240:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa1d8aa9164aa2ca3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.139246:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4113b37a00/0xa1d8aa9164aa2c9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa1d8aa9164aa2ca3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.139260:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940848.139263:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2eda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.139269:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4136235600 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:1.0:1788940848.139271:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa1d8aa9164aa2eda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.139276:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa1d8aa9164aa2eda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940848.139283:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa1d8aa9164aa2eda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940848.139288:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788940848.139290:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788940848.139297:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788940848.139302:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f4118287800 00010000:00010000:1.0:1788940848.139306:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa1d8aa9164aa2eda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.139313:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4136235600/0xa1d8aa9164aa2ed3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa1d8aa9164aa2eda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940848.139325:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940848.139327:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940848.139329:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940848.140361:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788940848.151504:0:13324:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f413f375a20 - data ffff8f411dbf4d80/ffff8f41352b3400 00000020:01000000:3.0:1788940848.151632:0:13324:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f4107309840 - data ffff8f413fda90d8/ffff8f413f68ac00 00100000:10000000:3.0:1788940848.164033:0:13324:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788940848.225963:0:13324:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2b92 00000020:00000080:0.0:1788940848.225972:0:13324:0:(genops.c:885:class_export_put()) final put ffff8f413a746000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788940848.225995:0:13324:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f413f3b7800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788940848.225999:0:13324:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f413f3b7800 2 00000020:01000004:0.0:1788940848.226002:0:13324:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f413f3b7800 from lustre-OST0001 00000020:00000080:0.0:1788940848.226024:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940848.226034:0:13324:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788940848.226037:0:13324:0:(genops.c:885:class_export_put()) final put ffff8f4105216000/lustre-OST0001_UUID 00000020:00000080:0.0:1788940848.226040:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4105216000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788940848.226046:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1788940848.226248:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413a746000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1788940848.226457:0:13324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d726abb2-e4c2-4da6-a0b4-cf7a68b51e04->MGS 00010000:00010000:0.0:1788940848.226473:0:13324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa2aa4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa1d8aa9164aa2aab expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940848.226495:0:13324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa2aa4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa1d8aa9164aa2aab expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940848.226501:0:13324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788940848.226504:0:13324:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788940848.226507:0:13324:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788940848.226521:0:13324:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f4118287800 00010000:00010000:0.0:1788940848.226524:0:13324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa2aa4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa1d8aa9164aa2aab expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940848.226540:0:13324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4136234e00/0xa1d8aa9164aa2ce2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa1d8aa9164aa2ce9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940848.226547:0:13324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4136234e00/0xa1d8aa9164aa2ce2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa1d8aa9164aa2ce9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940848.226552:0:13324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788940848.226554:0:13324:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788940848.226555:0:13324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788940848.226570:0:13324:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f4118287800 00010000:00010000:0.0:1788940848.226573:0:13324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4136234e00/0xa1d8aa9164aa2ce2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa1d8aa9164aa2ce9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788940848.229770:0:13324:0:(import.c:65:import_set_state_nolock()) ffff8f4118287800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788940848.229780:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788940848.229783:0:13324:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788940848.229784:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788940848.229789:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788940848.229802:0:13324:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f40039c5f80 x1875840068576768/t0(0) o250->MGC192.168.202.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788940850 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788940848.229819:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788940848.229822:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1788940848.230418:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d726abb2-e4c2-4da6-a0b4-cf7a68b51e04:3300:1875840068576768:0@lo:250:kworker.0 10000000:01000000:1.0:1788940848.230568:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788940848.230576:0:13324:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2985 00000020:00000080:1.0:1788940848.230751:0:13324:0:(genops.c:885:class_export_put()) final put ffff8f4118283000/d726abb2-e4c2-4da6-a0b4-cf7a68b51e04 00000020:01000000:1.0:1788940848.230772:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.117@tcp (flags='') 00000020:00000080:1.0:1788940848.230781:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940848.230789:0:13324:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.117@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788940848.230793:0:13324:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8f4118288000) has no exports 10000000:01000000:0.0:1788940848.230881:0:5830:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1788940848.234154:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4118283000/d726abb2-e4c2-4da6-a0b4-cf7a68b51e04 for MGC192.168.202.117@tcp 10000000:01000000:1.0:1788940848.244528:0:13324:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.202.117@tcp: client import never connected 00000100:00080000:1.0:1788940848.244537:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788940848.244541:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788940848.244544:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788940848.244564:0:13324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788940848.244656:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940848.244666:0:13324:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.117@tcp (uuid d726abb2-e4c2-4da6-a0b4-cf7a68b51e04) 00000020:01000000:1.0:1788940848.244674:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788940848.244679:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940848.244684:0:13324:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788940848.244703:0:13324:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8f413a743800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788940848.244710:0:13324:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8f413f418000) has exports, disconnecting them 00000020:00080000:1.0:1788940848.244714:0:13324:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8f413a743800), last request at 1788940615 00000020:00000080:1.0:1788940848.244718:0:13324:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2bbc 00000020:00080000:1.0:1788940848.244734:0:13324:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f413a743800): rc 0 00000020:00000080:1.0:1788940848.244738:0:13324:0:(genops.c:885:class_export_put()) final put ffff8f413a743800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788940848.245480:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f4118287800 for MGC192.168.202.117@tcp 00000020:00000080:2.0:1788940848.245489:0:8:0:(genops.c:885:class_export_put()) final put ffff8f4118282000/d726abb2-e4c2-4da6-a0b4-cf7a68b51e04 00000020:00000080:2.0:1788940848.245491:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4118282000/d726abb2-e4c2-4da6-a0b4-cf7a68b51e04 for MGC192.168.202.117@tcp 00000020:01000000:2.0:1788940848.245500:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.117@tcp (d726abb2-e4c2-4da6-a0b4-cf7a68b51e04) 00000020:00000080:2.0:1788940848.245743:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413a743800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788940848.245844:0:13324:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788940848.245848:0:13324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940848.245852:0:13324:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788940848.245858:0:13324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788940848.246706:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8f413a744000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788940848.247053:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788940848.248304:0:7620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788940848.248553:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1788940848.249385:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1788940848.249573:0:5815:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8f411378ec00:5815] 0 exiting: rc = 1 00000100:00100000:2.0:1788940848.249722:0:5816:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8f4108100200:5816] 1 exiting: rc = 0 00000100:00100000:0.0:1788940848.250000:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.250331:0:5818:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8f411289a000:5818] 1 exiting: rc = 0 00000100:00100000:2.0:1788940848.250404:0:5817:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8f4108100600:5817] 0 exiting: rc = 1 00000100:00100000:2.0:1788940848.255285:0:7622:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8f41352dc000:7622] 3 exiting: rc = 0 00000100:00100000:0.0:1788940848.255567:0:5819:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8f4132508e00:5819] 2 exiting: rc = 0 00000100:00100000:2.0:1788940848.255786:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255794:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255800:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255807:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255813:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255839:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255845:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255851:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255856:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255862:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255868:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255875:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255880:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255885:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255901:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255914:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255922:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255927:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255933:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255938:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255943:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255949:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255953:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255958:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255963:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255968:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255973:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255978:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255984:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255989:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.255994:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256000:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256004:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256009:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256013:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256018:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256024:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256029:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256035:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256050:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256064:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256069:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256074:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256079:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256084:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256090:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256096:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256101:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256106:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256111:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256117:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256122:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256127:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256133:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256138:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256143:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256149:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256154:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256160:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256165:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256170:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256175:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256181:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.256230:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788940848.274012:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940848.274026:0:13324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788940848.274031:0:13324:0:(genops.c:885:class_export_put()) final put ffff8f413a740800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788940848.274036:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413a740800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788940848.274058:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788940848.274116:0:13324:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f413f3b7800 1 00000020:00000080:2.0:1788940848.274123:0:13324:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xa1d8aa9164aa2b61 00000020:00000080:2.0:1788940848.274129:0:13324:0:(genops.c:885:class_export_put()) final put ffff8f4111443000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788940848.274141:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788940848.274150:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f4111443000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788940848.274174:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940848.274179:0:13324:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788940848.274183:0:13324:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8f41412999c0) has no exports 00000020:00000080:2.0:1788940848.291533:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940848.291548:0:13324:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788940848.291554:0:13324:0:(genops.c:885:class_export_put()) final put ffff8f413f3b2800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788940848.291558:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff8f413f3b2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788940848.291566:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788940848.291770:0:13324:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f413f3b4000 00000020:01000000:2.0:1788940848.291794:0:13324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788940848.291798:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940848.291803:0:13324:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788940848.291807:0:13324:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8f4134e5cd40) has no exports 00000020:00000080:2.0:1788940848.291829:0:13324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940848.291836:0:13324:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788940848.291839:0:13324:0:(genops.c:885:class_export_put()) final put ffff8f41346b0800/OSS_uuid 00000020:00000080:2.0:1788940848.291841:0:13324:0:(genops.c:844:class_export_destroy()) destroying export ffff8f41346b0800/OSS_uuid for OSS 00000020:01000000:2.0:1788940848.291845:0:13324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788940848.291928:0:8426:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8f41411e6e00:8426] 3 exiting: rc = 0 00000100:00100000:2.0:1788940848.292018:0:12520:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8f413f3c7600:12520] 4 exiting: rc = 0 00000100:00100000:2.0:1788940848.292077:0:6671:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8f412ba12200:6671] 0 exiting: rc = 1 00000100:00100000:2.0:1788940848.292125:0:6673:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8f411291ec00:6673] 1 exiting: rc = 0 00000100:00100000:2.0:1788940848.292164:0:6674:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8f4139f88e00:6674] 2 exiting: rc = 0 00000100:00100000:2.0:1788940848.292240:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292248:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292256:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292262:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292267:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292271:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292277:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292281:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292286:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292302:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292307:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292312:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292317:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292322:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292327:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292332:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292337:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292354:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292360:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292365:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292370:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292375:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292380:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292385:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292390:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292395:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292400:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292405:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292410:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292415:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292420:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292425:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292430:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292435:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292439:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292445:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292451:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292456:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292461:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292466:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292472:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292478:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292483:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292488:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292500:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292505:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292510:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292515:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292520:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292525:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292530:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292535:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292540:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292545:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292550:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292555:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292560:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292566:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292571:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292576:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292582:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292587:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292592:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.292598:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.293389:0:6676:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8f412ba38200:6676] 1 exiting: rc = 0 00000100:00080000:0.0:1788940848.297123:0:5829:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788940848.298080:0:6675:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8f41350ae000:6675] 0 exiting: rc = 1 00000100:00100000:2.0:1788940848.298311:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298321:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298327:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298333:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298339:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298356:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298361:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298366:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298372:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298377:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298382:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298388:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298393:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298399:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298415:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298421:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298427:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298432:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298437:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298444:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298449:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298455:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298460:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298466:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298472:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298477:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298483:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298504:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298510:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298516:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298522:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298527:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298532:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298538:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298543:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298549:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298553:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298559:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298564:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298568:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298573:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298579:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298584:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298600:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298607:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298612:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298618:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298623:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298628:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298640:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298645:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298654:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298660:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298666:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298671:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298676:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298681:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298685:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298702:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298707:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298712:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298717:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298722:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.298728:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940848.300386:0:6679:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8f412ba39200:6679] 2 exiting: rc = 0 00000100:00100000:1.0:1788940848.303974:0:6677:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8f412ba38000:6677] 0 exiting: rc = 1 00000100:00100000:3.0:1788940848.304400:0:6678:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8f41350ae400:6678] 1 exiting: rc = 0 00000100:00100000:2.0:1788940848.304560:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304570:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304577:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304583:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304600:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304607:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304612:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304618:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304625:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304631:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304637:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304643:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304651:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304657:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304662:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304667:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304673:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304704:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304712:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304720:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304738:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304744:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304750:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304755:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304761:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304768:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304774:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304780:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304786:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304793:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304798:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304802:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304808:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304814:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304820:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304826:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304831:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304836:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304841:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304846:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304851:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304870:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304877:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304882:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304888:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304892:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304899:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304904:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304910:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304916:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304921:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304927:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304931:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304937:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304942:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304954:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304960:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304966:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304971:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304976:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304982:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304988:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.304993:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.305005:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.313149:0:6680:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8f4139f5cc00:6680] 0 exiting: rc = 1 00000100:00100000:2.0:1788940848.314679:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8f4139f5d600:6681] 1 exiting: rc = 0 00000100:00100000:2.0:1788940848.314776:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314783:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314789:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314794:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314800:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314805:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314810:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314817:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314822:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314828:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314833:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314838:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314842:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314847:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314851:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314856:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314860:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314865:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314870:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314876:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314882:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314887:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314893:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314898:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314920:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314926:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314931:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314936:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314941:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314948:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314955:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314961:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314966:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314972:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314977:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314983:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314988:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314994:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.314999:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315004:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315011:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315017:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315022:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315028:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315033:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315039:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315045:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315051:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315057:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315062:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315068:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315073:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315077:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315083:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315088:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315093:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315098:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315108:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315116:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315131:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315136:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315141:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315147:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.315152:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940848.318665:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8f4135092a00:6682] 0 exiting: rc = 1 00000100:00100000:3.0:1788940848.319752:0:6683:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8f41346afc00:6683] 1 exiting: rc = 0 00000100:00100000:2.0:1788940848.319917:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.319926:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.319933:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.319940:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.319947:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.319953:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.319959:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.319965:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.319972:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.319989:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.319997:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320002:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320008:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320016:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320022:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320028:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320034:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320042:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320047:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320052:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320059:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320079:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320087:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320093:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320100:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320105:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320111:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320117:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320124:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320130:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320146:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320152:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320158:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320177:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320184:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320207:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320213:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320220:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320226:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320231:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320239:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320245:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320251:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320257:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320262:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320282:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320288:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320294:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320299:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320305:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320311:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320317:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320324:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320331:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320337:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320357:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320365:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320387:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320394:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320399:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320405:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320411:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320417:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940848.320430:0:13324:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788940848.339377:0:13324:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788940866.739376:0:13952:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg217-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788940876.242928:0:14412:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788940876.242933:0:14412:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788940876.243112:0:14412:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f4002627000 00000020:01000004:2.0:1788940876.243131:0:14412:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788940876.243140:0:14412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788940876.243154:0:14412:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8f41412999c0) 00000020:00000080:2.0:1788940876.243171:0:14412:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788940876.267965:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788940876.270596:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1788940876.271128:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 399: rc = 0 00100000:10000000:1.0:1788940876.271254:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 399: rc = 0 00100000:10000000:1.0:1788940876.271392:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 399: rc = 0 00100000:10000000:1.0:1788940876.271503:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 399: rc = 0 00100000:10000000:1.0:1788940876.271632:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 399: rc = 0 00100000:10000000:1.0:1788940876.271938:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788940876.272355:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 399: rc = 0 00100000:10000000:1.0:1788940876.273106:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 401: rc = 0 00100000:10000000:1.0:1788940876.274395:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 215: rc = 0 00100000:10000000:1.0:1788940876.274514:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 215: rc = 0 00100000:10000000:1.0:1788940876.275223:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 538: rc = 0 00100000:10000000:1.0:1788940876.275594:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 538: rc = 0 00100000:10000000:1.0:1788940876.275989:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 538: rc = 0 00100000:10000000:1.0:1788940876.276498:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 538: rc = 0 00100000:10000000:1.0:1788940876.276760:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 538: rc = 0 00100000:10000000:1.0:1788940876.277309:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 538: rc = 0 00100000:10000000:1.0:1788940876.277582:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 538: rc = 0 00100000:10000000:1.0:1788940876.278414:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 538: rc = 0 00100000:10000000:1.0:1788940876.278686:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 538: rc = 0 00100000:10000000:1.0:1788940876.279151:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 538: rc = 0 00100000:10000000:1.0:1788940876.279412:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 538: rc = 0 00100000:10000000:1.0:1788940876.279623:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 538: rc = 0 00100000:10000000:1.0:1788940876.280286:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 770: rc = 0 00100000:10000000:1.0:1788940876.280554:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 770: rc = 0 00100000:10000000:1.0:1788940876.280934:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 770: rc = 0 00100000:10000000:1.0:1788940876.281356:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 770: rc = 0 00100000:10000000:1.0:1788940876.281634:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 770: rc = 0 00100000:10000000:1.0:1788940876.282102:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 770: rc = 0 00100000:10000000:1.0:1788940876.282445:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 770: rc = 0 00100000:10000000:1.0:1788940876.282699:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 770: rc = 0 00100000:10000000:1.0:1788940876.283454:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 770: rc = 0 00100000:10000000:1.0:1788940876.283707:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 770: rc = 0 00100000:10000000:1.0:1788940876.284318:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 770: rc = 0 00100000:10000000:1.0:1788940876.284588:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 770: rc = 0 00100000:10000000:1.0:1788940876.285090:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 770: rc = 0 00100000:10000000:1.0:1788940876.285376:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 770: rc = 0 00100000:10000000:1.0:1788940876.285633:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 770: rc = 0 00100000:10000000:1.0:1788940876.286157:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 770: rc = 0 00100000:10000000:1.0:1788940876.286569:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 770: rc = 0 00100000:10000000:1.0:1788940876.291589:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 770: rc = 0 00100000:10000000:1.0:1788940876.292298:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 770: rc = 0 00100000:10000000:1.0:1788940876.292551:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 770: rc = 0 00100000:10000000:1.0:1788940876.292766:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 770: rc = 0 00100000:10000000:1.0:1788940876.293268:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 770: rc = 0 00100000:10000000:1.0:1788940876.293561:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 770: rc = 0 00100000:10000000:1.0:1788940876.293776:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 770: rc = 0 00100000:10000000:1.0:1788940876.294057:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 770: rc = 0 00100000:10000000:1.0:1788940876.295082:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 770: rc = 0 00100000:10000000:1.0:1788940876.295551:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 770: rc = 0 00100000:10000000:1.0:1788940876.295736:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 770: rc = 0 00100000:10000000:1.0:1788940876.296407:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 770: rc = 0 00100000:10000000:1.0:1788940876.296612:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 770: rc = 0 00100000:10000000:1.0:1788940876.298611:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 770: rc = 0 00100000:10000000:1.0:1788940876.298898:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 770: rc = 0 00100000:10000000:1.0:1788940876.300035:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 643: rc = 0 00100000:10000000:1.0:1788940876.300574:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788940876.300739:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 537: rc = 0 00100000:10000000:0.0:1788940876.301535:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788940876.301618:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 537: rc = 0 00100000:10000000:0.0:1788940876.302294:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788940876.302374:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 537: rc = 0 00100000:10000000:0.0:1788940876.302768:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1788940876.303296:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 216: rc = 0 00100000:10000000:0.0:1788940876.303528:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1788940876.303604:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 216: rc = 0 00100000:10000000:0.0:1788940876.305421:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1788940876.305551:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 216: rc = 0 00000020:00000080:0.0:1788940876.305934:0:14412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788940876.305942:0:14412:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788940876.305953:0:14412:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa1d8aa9164aa3c78 00000020:01000004:0.0:1788940876.305960:0:14412:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788940876.305966:0:14412:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788940876.305971:0:14412:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f4002627000 from MGS 00000020:01000004:0.0:1788940876.305975:0:14412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788940876.306290:0:14412:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8f411828cd40) 00000020:00000080:0.0:1788940876.306303:0:14412:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788940876.306363:0:14412:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f4002627000 from MGS, refs=2 00080000:01000000:0.0:1788940876.306368:0:14412:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788940876.306374:0:14412:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa1d8aa9164aa3c86 00000100:00100000:0.0:1788940876.306487:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788940876.306614:0:14412:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788940876.306621:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788940876.307359:0:14412:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788940876.307368:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788940876.308245:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940876.308403:0:14412:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788940876.308415:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788940876.310501:0:14412:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788940876.310514:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788940876.311085:0:14412:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788940876.311092:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788940876.312100:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940876.312106:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940876.312108:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940876.313694:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940876.313700:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940876.313702:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940876.314701:0:14412:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788940876.323482:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788940876.336662:0:14412:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788940876.336680:0:14412:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788940876.336683:0:14412:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788940876.338881:0:14421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788940876.339091:0:14412:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788940876.339222:0:14412:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788940876.339721:0:14412:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788940876.340055:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940876.340275:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788940876.340282:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788940876.342938:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788940876.342950:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788940876.344134:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788940876.344145:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788940876.347605:0:14412:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788940876.347629:0:14412:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.117@tcp' 00000020:01000004:0.0:1788940876.347632:0:14412:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788940876.347668:0:14412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.117@tcp (typ=mgc) 00000020:00000080:0.0:1788940876.347680:0:14412:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.117@tcp (ffff8f41182899c0) 00000020:00000080:0.0:1788940876.347697:0:14412:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788940876.347785:0:14412:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f41411f8800@MGC192.168.202.117@tcp: add connection 192.168.202.117@tcp at head 00010000:00010000:0.0:1788940876.348526:0:14412:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.117@tcp-0 is initialized 00000040:01000000:0.0:1788940876.348534:0:14412:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.117@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788940876.349489:0:14427:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788940876.349535:0:14412:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.117@tcp (uuid 340eef01-7b53-49af-9aa3-2abb708ce8bb) 00000020:00000080:0.0:1788940876.349554:0:14412:0:(genops.c:1384:class_connect()) connect: client 340eef01-7b53-49af-9aa3-2abb708ce8bb, cookie 0xa1d8aa9164aa3c94 00000100:00080000:0.0:1788940876.349565:0:14412:0:(import.c:545:import_select_connection()) MGC192.168.202.117@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940876.349582:0:14412:0:(import.c:666:import_select_connection()) MGC192.168.202.117@tcp: import ffff8f41411f8800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:0.0:1788940876.349616:0:14412:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f40039c4000 x1875840068577152/t0(0) o250->MGC192.168.202.117@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940876.349640:0:14412:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 340eef01-7b53-49af-9aa3-2abb708ce8bb->MGS 00000020:01000004:0.0:1788940876.349659:0:14412:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788940876.349664:0:14412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788940876.352673:0:14412:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8f4118288000) 00000020:00000080:0.0:1788940876.352710:0:14412:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:3.0:1788940876.354566:0:14426:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1788940876.356141:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:340eef01-7b53-49af-9aa3-2abb708ce8bb:3300:1875840068577152:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788940876.356236:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940876.357553:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068577152 00000100:00100000:3.0:1788940876.357567:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068577152 00000100:00100000:3.0:1788940876.357620:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940876.357630:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f35dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3300:x1875840068577152:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788940876.357670:0:14422:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 340eef01-7b53-49af-9aa3-2abb708ce8bb@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:3.0:1788940876.357700:0:14422:0:(genops.c:1384:class_connect()) connect: client 340eef01-7b53-49af-9aa3-2abb708ce8bb, cookie 0xa1d8aa9164aa3ca2 00000100:00080000:3.0:1788940876.359112:0:14422:0:(import.c:65:import_set_state_nolock()) ffff8f4108744000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788940876.359235:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f35dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+5:3300:x1875840068577152:12345-0@lo:250:mount.lustre.0 Request processed in 1603us (2996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940876.359245:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940876.360421:0:3300:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.117@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788940876.360449:0:3300:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.117@tcp: connect to target with instance 0 00000100:00080000:3.0:1788940876.360459:0:3300:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.117@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788940876.360464:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788940876.360468:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f41411f8800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788940876.360471:0:3300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788940876.360484:0:3300:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788940876.360492:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:340eef01-7b53-49af-9aa3-2abb708ce8bb:3300:1875840068577152:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788940876.377552:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940876.377775:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788940876.377782:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788940876.383918:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788940876.383930:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788940876.385506:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788940876.385518:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788940876.387708:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940876.387977:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788940876.387983:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788940876.390463:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788940876.390480:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788940876.430972:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940876.431422:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788940876.431441:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788940876.432747:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788940876.432759:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788940876.433585:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940876.433752:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788940876.433758:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788940876.434485:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788940876.434493:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788940876.435497:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940876.435665:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788940876.435670:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788940876.436489:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788940876.436497:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788940876.437131:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940876.437525:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788940876.437531:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788940876.438249:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788940876.438258:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788940876.462789:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788940876.464521:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788940876.464531:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788940876.473999:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788940876.474164:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788940876.475288:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788940876.475299:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788940876.485036:0:14412:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788940876.485093:0:14412:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788940876.485101:0:14412:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.117@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788940876.485257:0:14412:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.117@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788940876.485317:0:14412:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.117@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788940876.485322:0:14412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788940876.485324:0:14412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788940876.485325:0:14412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940876.485327:0:14412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940876.485328:0:14412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940876.485330:0:14412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940876.485331:0:14412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940876.485333:0:14412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788940876.485335:0:14412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940876.485336:0:14412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940876.485339:0:14412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788940876.485341:0:14412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940876.485342:0:14412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788940876.485343:0:14412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940876.485344:0:14412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940876.485346:0:14412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940876.485347:0:14412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940876.485348:0:14412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788940876.485349:0:14412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788940876.485350:0:14412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940876.485352:0:14412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940876.485380:0:14412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788940876.485399:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068577280:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788940876.485479:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940876.485537:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4111581300 going to sleep for 11 seconds 00000100:00100000:3.0:1788940876.485780:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068577280 00000100:00100000:3.0:1788940876.485788:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068577280 00000100:00100000:3.0:1788940876.485837:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940876.485846:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f35f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+5:14412:x1875840068577280:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788940876.485898:0:14424:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788940876.485901:0:14424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788940876.485904:0:14424:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788940876.486587:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788940876.487172:0:14424:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788940876.489129:0:14446:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788940876.489136:0:14446:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788940876.489139:0:14446:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788940876.489174:0:14446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788940876.489586:0:14424:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788940876.489599:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788940876.498422:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f35f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+5:14412:x1875840068577280:12345-0@lo:253:mount.lustre.0 Request processed in 12568us (12933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940876.498450:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940876.498546:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068577280:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788940876.498562:0:14412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788940876.498565:0:14412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788940876.498567:0:14412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788940876.498569:0:14412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940876.498570:0:14412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940876.498572:0:14412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940876.498573:0:14412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940876.498574:0:14412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788940876.498576:0:14412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788940876.498578:0:14412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940876.498579:0:14412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788940876.498603:0:14412:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f4002627000 from lustre-MDT0000 10000000:01000000:1.0:1788940876.498710:0:14412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788940876.498713:0:14412:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788940876.498718:0:14412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f41182899c0 10000000:01000000:1.0:1788940876.498722:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940876.498729:0:14412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f41182899c0 from 1 10000000:01000000:1.0:1788940876.498733:0:14412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788940876.498771:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d4200/0xa1d8aa9164aa3ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.498845:0:14412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f41073d4200/0xa1d8aa9164aa3ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.498924:0:14412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f41073d4200/0xa1d8aa9164aa3ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940876.498944:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068577408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940876.498986:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940876.499141:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940876.499262:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068577408 00000100:00100000:3.0:1788940876.499269:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068577408 00000100:00100000:3.0:1788940876.499398:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940876.499414:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f35f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+5:14412:x1875840068577408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940876.499441:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940876.499457:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4140f43000/0xa1d8aa9164aa3cb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3ca9 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940876.499480:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4140f43000/0xa1d8aa9164aa3cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3ca9 expref: 6 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940876.499489:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4140f43000/0xa1d8aa9164aa3cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3ca9 expref: 6 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940876.499499:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4140f43000, rc 0) 00000100:00100000:3.0:1788940876.499540:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f35f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+6:14412:x1875840068577408:12345-0@lo:101:mount.lustre.0 Request processed in 128us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940876.499546:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940876.499635:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068577408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940876.499648:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f41073d4200/0xa1d8aa9164aa3ca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3cb0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.499656:0:14412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f41073d4200/0xa1d8aa9164aa3ca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3cb0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940876.499706:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068577536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940876.499731:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940876.500111:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bf600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940876.500175:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068577536 00000100:00100000:0.0:1788940876.500180:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068577536 00000100:00100000:0.0:1788940876.500284:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788940876.500291:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4140d45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+6:14412:x1875840068577536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940876.500545:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4140d45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+6:14412:x1875840068577536:12345-0@lo:501:mount.lustre.0 Request processed in 253us (812us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788940876.500552:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788940876.500625:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068577536:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788940876.500654:0:14412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788940876.500673:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d4200/0xa1d8aa9164aa3ca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3cb0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.500682:0:14412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f41073d4200/0xa1d8aa9164aa3ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3cb0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940876.500691:0:14412:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f4002627000 10000000:01000000:1.0:1788940876.500696:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788940876.500700:0:14412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f4002627000 10000000:01000000:1.0:1788940876.500702:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788940876.500706:0:14412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f4002627000 from 1 10000000:01000000:1.0:1788940876.500708:0:14412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788940876.500725:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d5800/0xa1d8aa9164aa3cb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.500732:0:14412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f41073d5800/0xa1d8aa9164aa3cb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.500746:0:14412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f41073d5800/0xa1d8aa9164aa3cb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940876.500761:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068577664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940876.500957:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940876.500982:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bf600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940876.501065:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068577664 00000100:00100000:0.0:1788940876.501070:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068577664 00000100:00100000:0.0:1788940876.501088:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940876.501094:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4140d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+6:14412:x1875840068577664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940876.501108:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940876.501120:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4100031200/0xa1d8aa9164aa3cbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3cb7 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.501136:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4100031200/0xa1d8aa9164aa3cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3cb7 expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.501145:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4100031200/0xa1d8aa9164aa3cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3cb7 expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.501152:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100031200, rc 0) 00000100:00100000:0.0:1788940876.501176:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4140d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+7:14412:x1875840068577664:12345-0@lo:101:mount.lustre.0 Request processed in 82us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940876.501181:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788940876.501278:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068577664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940876.501289:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f41073d5800/0xa1d8aa9164aa3cb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3cbe expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.501297:0:14412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f41073d5800/0xa1d8aa9164aa3cb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3cbe expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940876.501309:0:14412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788940876.501315:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d5800/0xa1d8aa9164aa3cb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3cbe expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.501322:0:14412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f41073d5800/0xa1d8aa9164aa3cb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3cbe expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940876.501328:0:14412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788940876.501331:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940876.501336:0:14412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f4002627000 10000000:01000000:1.0:1788940876.501339:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788940876.501342:0:14412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788940876.501344:0:14412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788940876.501357:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d4e00/0xa1d8aa9164aa3cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.501371:0:14412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f41073d4e00/0xa1d8aa9164aa3cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.501378:0:14412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f41073d4e00/0xa1d8aa9164aa3cc5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940876.501389:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068577792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940876.501413:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940876.501439:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bf600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940876.501496:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068577792 00000100:00100000:0.0:1788940876.501501:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068577792 00000100:00100000:0.0:1788940876.501517:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788940876.501523:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4140d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+7:14412:x1875840068577792:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940876.501529:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940876.501537:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4100030e00/0xa1d8aa9164aa3ccc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3cc5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.501549:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4100030e00/0xa1d8aa9164aa3ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3cc5 expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.501557:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4100030e00/0xa1d8aa9164aa3ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3cc5 expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.501563:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100030e00, rc 0) 00000100:00100000:0.0:1788940876.501603:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4140d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+8:14412:x1875840068577792:12345-0@lo:101:mount.lustre.0 Request processed in 80us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940876.501609:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940876.506326:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068577792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940876.506357:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f41073d4e00/0xa1d8aa9164aa3cc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3ccc expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.506369:0:14412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f41073d4e00/0xa1d8aa9164aa3cc5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3ccc expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940876.506463:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068577920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940876.506523:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940876.506568:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bf600 going to sleep for 11 seconds 00000100:00100000:0.0:1788940876.506622:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068577920 00000100:00100000:0.0:1788940876.506630:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068577920 00000100:00100000:0.0:1788940876.506677:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788940876.506687:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4140d47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+8:14412:x1875840068577920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940876.507124:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4140d47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+9:14412:x1875840068577920:12345-0@lo:501:mount.lustre.0 Request processed in 438us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940876.507132:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940876.507363:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068577920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940876.507394:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068578048:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940876.507445:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940876.507472:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940876.507604:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068578048 00000100:00100000:3.0:1788940876.507610:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068578048 00000100:00100000:3.0:1788940876.507636:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788940876.507644:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4140d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+9:14412:x1875840068578048:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940876.507962:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4140d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+9:14412:x1875840068578048:12345-0@lo:503:mount.lustre.0 Request processed in 318us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940876.507969:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788940876.508133:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068578048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788940876.508504:0:14447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a697800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:340eef01-7b53-49af-9aa3-2abb708ce8bb:14447:1875840068578176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940876.508544:0:14447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940876.508567:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068578176 00000100:00100000:3.0:1788940876.508571:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068578176 00000100:00100000:3.0:1788940876.508593:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940876.508600:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4140d45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+9:14447:x1875840068578176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940876.509222:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4140d45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+9:14447:x1875840068578176:12345-0@lo:502:llog_process_th.0 Request processed in 619us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940876.509231:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788940876.509276:0:14447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4113b35cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940876.509290:0:14447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a697800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:340eef01-7b53-49af-9aa3-2abb708ce8bb:14447:1875840068578176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788940876.509318:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940876.509330:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940876.509333:0:14447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788940876.509338:0:14447:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788940876.509341:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940876.509355:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8f4134e58000) 00000020:00000080:3.0:1788940876.509372:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788940876.509378:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788940876.509455:0:14447:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788940876.509463:0:14447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa1d8aa9164aa3cda 00000020:00000080:3.0:1788940876.509671:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788940876.509675:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940876.509679:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940876.509680:0:14447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788940876.509683:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940876.509687:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940876.509688:0:14447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788940876.509692:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788940876.509699:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8f4134e5b380) 00000020:00000080:3.0:1788940876.509708:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788940876.509712:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788940876.509714:0:14447:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788940876.509717:0:14447:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788940876.509723:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788940876.509787:0:14447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f4002627000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788940876.509816:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8f4134e5cd40) 00000020:00000080:3.0:1788940876.509825:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788940876.510745:0:14447:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788940876.510757:0:14447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa1d8aa9164aa3cef 00000020:00000080:3.0:1788940876.511078:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788940876.511084:0:14447:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788940876.511089:0:14447:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa1d8aa9164aa3cf6 00080000:01000000:3.0:1788940876.511094:0:14447:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788940876.511098:0:14447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa1d8aa9164aa3cfd 00010000:00010000:3.0:1788940876.623093:0:14447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788940876.624256:0:14447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788940876.624614:0:14447:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788940876.626859:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8f4134e599c0) 00000020:00000080:3.0:1788940876.626882:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788940876.626954:0:14447:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788940876.626960:0:14447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa1d8aa9164aa3d0b 00000020:00000080:2.0:1788940876.628609:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788940876.633162:0:14447:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa1d8aa9164aa3d12 00000020:00000080:0.0:1788940876.641831:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788940876.641846:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940876.642520:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940876.642529:0:14447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788940876.642537:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940876.642545:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940876.642547:0:14447:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788940876.642552:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788940876.642602:0:14447:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788940876.642623:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940876.642627:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940876.642628:0:14447:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788940876.642631:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788940876.642633:0:14447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1788940876.642635:0:14447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788940876.642637:0:14447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788940876.642638:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788940876.642640:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940876.642641:0:14447:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788940876.642643:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940876.642647:0:14447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788940876.642649:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940876.642650:0:14447:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788940876.642653:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788940876.642658:0:14447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.117@tcp to nid 0x20000c0a8ca75 (192.168.202.117@tcp) 00000020:01000000:1.0:1788940876.642695:0:14447:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788940876.642699:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940876.642715:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f413f418000) 00000020:00000080:1.0:1788940876.642732:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788940876.642738:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788940876.642804:0:14447:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788940876.642809:0:14447:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788940876.642816:0:14447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa1d8aa9164aa3d20 00010000:00080000:1.0:1788940876.642847:0:14447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f4134e53800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.117@tcp at head 00010000:00010000:1.0:1788940876.643082:0:14447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788940876.643523:0:14447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788940876.643580:0:14447:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788940876.644562:0:14447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940876.644643:0:14447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788940876.644717:0:14447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788940876.649745:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788940876.649754:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788940876.653122:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788940876.653138:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788940876.653175:0:14447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788940876.655968:0:14447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa1d8aa9164aa3d27 00000100:00080000:1.0:1788940876.655996:0:14447:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788940876.656009:0:14447:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f4134e53800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:1.0:1788940876.656073:0:14447:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4002db5880 x1875840068578304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940876.656107:0:14447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788940876.656228:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940876.656235:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940876.656238:0:14447:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788940876.656241:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788940876.656243:0:14447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788940876.656245:0:14447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788940876.656246:0:14447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788940876.656247:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788940876.656250:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940876.656251:0:14447:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788940876.656253:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940876.656267:0:14447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788940876.656271:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940876.656272:0:14447:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788940876.656275:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788940876.656279:0:14447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.117@tcp to nid 0x20000c0a8ca75 (192.168.202.117@tcp) 00000020:01000000:1.0:1788940876.657281:0:14447:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788940876.657374:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940876.657391:0:14447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f413f4199c0) 00000020:00000080:1.0:1788940876.657412:0:14447:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788940876.657419:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788940876.657518:0:14447:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788940876.657525:0:14447:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788940876.657532:0:14447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa1d8aa9164aa3d35 00010000:00080000:1.0:1788940876.657568:0:14447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f410f4f3800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.117@tcp at head 00000100:00100000:3.0:1788940876.657904:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068578304:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788940876.657961:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875840068578304 offset 0 length 520: 4 00010000:00010000:1.0:1788940876.658473:0:14447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788940876.658676:0:14447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788940876.658704:0:14447:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788940876.660092:0:14447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940876.661104:0:14447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788940876.661485:0:14447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788940876.662104:0:14453:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788940876.662109:0:14453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788940876.664661:0:14447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788940876.664676:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788940876.664735:0:14447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788940876.664755:0:14447:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa1d8aa9164aa3d3c 00000100:00080000:0.0:1788940876.664766:0:14447:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940876.664950:0:14447:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f410f4f3800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:0.0:1788940876.665059:0:14447:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f40039c6d80 x1875840068578432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940876.665140:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068578432:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788940876.665224:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875840068578432 offset 0 length 520: 4 00000100:00080000:0.0:1788940876.665574:0:14447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788940876.665647:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940876.665664:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940876.665666:0:14447:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788940876.665670:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940876.665674:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940876.665675:0:14447:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788940876.665678:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788940876.665680:0:14447:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788940876.665689:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940876.665691:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940876.665693:0:14447:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788940876.665696:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940876.665698:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940876.665699:0:14447:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788940876.665703:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788940876.665734:0:14447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:340eef01-7b53-49af-9aa3-2abb708ce8bb:14447:1875840068578560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940876.666316:0:14447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940876.666348:0:14447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f7cef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940876.666408:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068578560 00000100:00100000:2.0:1788940876.666416:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068578560 00000100:00100000:2.0:1788940876.666486:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940876.666495:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4140d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+9:14447:x1875840068578560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788940876.666762:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4140d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+9:14447:x1875840068578560:12345-0@lo:502:llog_process_th.0 Request processed in 267us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940876.666785:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788940876.667074:0:14447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:340eef01-7b53-49af-9aa3-2abb708ce8bb:14447:1875840068578560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940876.667103:0:14447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940876.667110:0:14447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940876.667112:0:14447:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788940876.667117:0:14447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788940876.667599:0:14412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788940876.667620:0:14412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788940876.667644:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d4e00/0xa1d8aa9164aa3cc5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3ccc expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940876.667657:0:14412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f41073d4e00/0xa1d8aa9164aa3cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3ccc expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940876.667666:0:14412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f4002627000 from 1 10000000:01000000:2.0:1788940876.667669:0:14412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788940876.667703:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940876.667711:0:14412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940876.667721:0:14412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940876.667738:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068578688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788940876.667907:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940876.667939:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41109d8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940876.667960:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068578688 00000100:00100000:2.0:1788940876.667966:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068578688 00000100:00100000:2.0:1788940876.668021:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940876.668029:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+9:14412:x1875840068578688:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940876.668040:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940876.668054:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3d43 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940876.668079:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3d43 expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940876.668090:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3d43 expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940876.668099:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7c00, rc 0) 00000100:00100000:2.0:1788940876.668134:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+10:14412:x1875840068578688:12345-0@lo:101:mount.lustre.0 Request processed in 107us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940876.668141:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788940876.668177:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068578688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940876.668223:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3d4a expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940876.668234:0:14412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3d4a expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940876.669486:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068578816:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788940876.669541:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940876.669567:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41109d8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940876.669589:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068578816 00000100:00100000:2.0:1788940876.669593:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068578816 00000100:00100000:2.0:1788940876.669652:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788940876.669661:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+10:14412:x1875840068578816:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788940876.669679:0:14422:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788940876.669686:0:14422:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788940876.669759:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+10:14412:x1875840068578816:12345-0@lo:256:mount.lustre.0 Request processed in 99us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940876.669765:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788940876.670113:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068578816:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788940876.672600:0:14412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788940876.672669:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3d4a expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940876.672684:0:14412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3d4a expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940876.672768:0:14412:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f4002627000 from 1 10000000:01000000:3.0:1788940876.672892:0:14412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788940876.672939:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940876.672948:0:14412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940876.672960:0:14412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940876.673067:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068578944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788940876.673132:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940876.673176:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4115c4e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788940876.673277:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068578944 00000100:00100000:1.0:1788940876.673401:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068578944 00000100:00100000:1.0:1788940876.673505:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940876.673516:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+10:14412:x1875840068578944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940876.673531:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940876.673546:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f41073d4c00/0xa1d8aa9164aa3d58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3d51 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.673568:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f41073d4c00/0xa1d8aa9164aa3d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3d51 expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.673578:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f41073d4c00/0xa1d8aa9164aa3d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3d51 expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.673585:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4c00, rc 0) 00000100:00100000:1.0:1788940876.673639:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+11:14412:x1875840068578944:12345-0@lo:101:mount.lustre.0 Request processed in 125us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940876.673646:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788940876.673716:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068578944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940876.673731:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3d58 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940876.673740:0:14412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3d58 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940876.673808:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068579072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940876.673838:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940876.674223:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4115c4e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788940876.674562:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068579072 00000100:00100000:2.0:1788940876.674568:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068579072 00000100:00100000:3.0:1788940876.674903:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940876.674911:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+11:14412:x1875840068579072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940876.675637:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+11:14412:x1875840068579072:12345-0@lo:501:mount.lustre.0 Request processed in 726us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940876.675646:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788940876.675742:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a697800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068579072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940876.675798:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068579200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940876.675840:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940876.675870:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41109d8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940876.676106:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068579200 00000100:00100000:1.0:1788940876.676112:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068579200 00000100:00100000:1.0:1788940876.676147:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940876.676155:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+11:14412:x1875840068579200:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940876.678660:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+11:14412:x1875840068579200:12345-0@lo:503:mount.lustre.0 Request processed in 2497us (2810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940876.678673:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940876.681012:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068579200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940876.683071:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:340eef01-7b53-49af-9aa3-2abb708ce8bb:14455:1875840068579328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940876.683156:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940876.683225:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f7ce9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940876.683406:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068579328 00000100:00100000:3.0:1788940876.683416:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068579328 00000100:00100000:3.0:1788940876.683475:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788940876.683484:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+11:14455:x1875840068579328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788940876.683770:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+11:14455:x1875840068579328:12345-0@lo:502:llog_process_th.0 Request processed in 286us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940876.683795:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940876.684103:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:340eef01-7b53-49af-9aa3-2abb708ce8bb:14455:1875840068579328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940876.684133:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940876.684143:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940876.684146:0:14455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788940876.684153:0:14455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f4002627000 00000020:00000080:0.0:1788940876.684155:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788940876.684162:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940876.684165:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940876.684166:0:14455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788940876.684168:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940876.684170:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940876.684171:0:14455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788940876.684181:0:14455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f4002627000 00000020:00000080:0.0:1788940876.684183:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788940876.684299:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940876.684303:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940876.684304:0:14455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788940876.684307:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788940876.684309:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940876.684311:0:14455:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788940876.684314:0:14455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f4002627000 00000020:00000080:0.0:1788940876.684316:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788940876.684356:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:340eef01-7b53-49af-9aa3-2abb708ce8bb:14455:1875840068579456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940876.684398:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940876.684438:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068579456 00000100:00100000:0.0:1788940876.684442:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068579456 00000100:00100000:0.0:1788940876.684470:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788940876.684476:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+11:14455:x1875840068579456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940876.684620:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+11:14455:x1875840068579456:12345-0@lo:502:llog_process_th.0 Request processed in 142us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940876.684627:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788940876.684665:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41016556c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940876.684678:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:340eef01-7b53-49af-9aa3-2abb708ce8bb:14455:1875840068579456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788940876.684696:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788940876.684700:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788940876.684702:0:14455:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788940876.684705:0:14455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788940876.689268:0:14412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788940876.689372:0:14412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940876.690388:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3d58 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.690417:0:14412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3d58 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940876.690487:0:14412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788940876.690490:0:14412:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f4002627000 10000000:01000000:0.0:1788940876.690493:0:14412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f4002627000 10000000:01000000:0.0:1788940876.690496:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788940876.690501:0:14412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f4002627000 from 1 10000000:01000000:0.0:1788940876.690503:0:14412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788940876.690545:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa3d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.690552:0:14412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa3d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.690563:0:14412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa3d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940876.690586:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068579584:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788940876.690653:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940876.690691:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a068000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940876.690718:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068579584 00000100:00100000:0.0:1788940876.690724:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068579584 00000100:00100000:0.0:1788940876.690763:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788940876.690785:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+11:14412:x1875840068579584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940876.690797:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940876.690808:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4100031400/0xa1d8aa9164aa3d66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3d5f expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.690840:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4100031400/0xa1d8aa9164aa3d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3d5f expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.690850:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4100031400/0xa1d8aa9164aa3d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3d5f expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.690857:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100031400, rc 0) 00000100:00100000:0.0:1788940876.690894:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14412:x1875840068579584:12345-0@lo:101:mount.lustre.0 Request processed in 124us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940876.690901:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788940876.690946:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068579584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940876.690959:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa3d5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3d66 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.690968:0:14412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa3d5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3d66 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940876.691403:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068579712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940876.691446:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940876.691470:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a068000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940876.692457:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068579712 00000100:00100000:2.0:1788940876.692469:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068579712 00000100:00100000:2.0:1788940876.692511:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788940876.692520:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14412:x1875840068579712:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940876.692804:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14412:x1875840068579712:12345-0@lo:501:mount.lustre.0 Request processed in 285us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940876.692818:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788940876.695001:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068579712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940876.695062:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068579840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940876.695126:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940876.695160:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a068000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940876.695178:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068579840 00000100:00100000:0.0:1788940876.695207:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068579840 00000100:00100000:0.0:1788940876.695248:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940876.695266:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14412:x1875840068579840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940876.695444:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14412:x1875840068579840:12345-0@lo:503:mount.lustre.0 Request processed in 188us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940876.695452:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788940876.695505:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068579840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940876.695656:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:340eef01-7b53-49af-9aa3-2abb708ce8bb:14457:1875840068579968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940876.695687:0:14457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940876.695702:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068579968 00000100:00100000:0.0:1788940876.695705:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068579968 00000100:00100000:0.0:1788940876.695723:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940876.695729:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14457:x1875840068579968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940876.695880:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14457:x1875840068579968:12345-0@lo:502:llog_process_th.0 Request processed in 150us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940876.695887:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788940876.695916:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a068000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940876.695926:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:340eef01-7b53-49af-9aa3-2abb708ce8bb:14457:1875840068579968:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788940876.695972:0:14457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788940876.695986:0:14457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8f411828b380) 00000020:00000080:0.0:1788940876.696003:0:14457:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788940876.696066:0:14457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f4002627000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788940876.696070:0:14457:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f4002627000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788940876.696073:0:14457:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f4002627000 4 00010000:00080000:0.0:1788940876.696096:0:14457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f4139f92800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.117@tcp at head 00010000:00010000:0.0:1788940876.697593:0:14457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788940876.697794:0:14457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788940876.697825:0:14457:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788940876.697837:0:14457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa1d8aa9164aa3d74 00000100:00080000:0.0:1788940876.697848:0:14457:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940876.697859:0:14457:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f4139f92800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:0.0:1788940876.697891:0:14457:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f40039c6680 x1875840068580096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940876.697922:0:14457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788940876.697976:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940876.697980:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788940876.697983:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940876.697985:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788940876.698015:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:340eef01-7b53-49af-9aa3-2abb708ce8bb:3301:1875840068580224:0@lo:400:kworker.0 00000100:00100000:0.0:1788940876.698069:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940876.698152:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068580224 00000100:00100000:0.0:1788940876.698158:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068580224 00000100:00100000:0.0:1788940876.698216:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940876.698226:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:3301:x1875840068580224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940876.698275:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:3301:x1875840068580224:12345-0@lo:400:kworker.0 Request processed in 50us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940876.698281:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788940876.698322:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:340eef01-7b53-49af-9aa3-2abb708ce8bb:3301:1875840068580224:0@lo:400:kworker.0 00000100:00100000:2.0:1788940876.708977:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875840068580096:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788940876.710062:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940876.710538:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068580096 00000100:00100000:3.0:1788940876.710550:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068580096 00000100:00100000:3.0:1788940876.710591:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940876.710598:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a03b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1875840068580096:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788940876.710674:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a03b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1875840068580096:12345-0@lo:38:llog_process_th.0 Request processed in 75us (688us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788940876.710681:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788940876.713750:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788940876.713766:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f4139f92800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940876.715129:0:3300:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788940876.715137:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875840068580096:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788940876.718099:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:340eef01-7b53-49af-9aa3-2abb708ce8bb:14457:1875840068580352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788940876.718217:0:14457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940876.718254:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bf840 going to sleep for 11 seconds 00000100:00100000:0.0:1788940876.718505:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068580352 00000100:00100000:0.0:1788940876.718514:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068580352 00000100:00100000:0.0:1788940876.718569:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788940876.718586:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14457:x1875840068580352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788940876.719385:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14457:x1875840068580352:12345-0@lo:502:llog_process_th.0 Request processed in 796us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940876.719395:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788940876.719473:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:340eef01-7b53-49af-9aa3-2abb708ce8bb:14457:1875840068580352:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788940876.719508:0:14457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788940876.719915:0:14412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788940876.719943:0:14412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788940876.719959:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa3d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3d66 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.719970:0:14412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4100030200/0xa1d8aa9164aa3d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3d66 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788940876.720093:0:14412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788940876.720095:0:14412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788940876.720096:0:14412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940876.720098:0:14412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940876.720099:0:14412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940876.720101:0:14412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940876.720102:0:14412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788940876.720103:0:14412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788940876.720105:0:14412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940876.720110:0:14412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788940876.720113:0:14412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788940876.720116:0:14412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788940876.720116:0:14412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788940876.720117:0:14412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940876.720118:0:14412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940876.720119:0:14412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940876.720120:0:14412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940876.720120:0:14412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788940876.720121:0:14412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788940876.720122:0:14412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940876.720123:0:14412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788940876.720143:0:14412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788940876.720156:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068580480:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788940876.720225:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940876.720270:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a7bf000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940876.720500:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068580480 00000100:00100000:0.0:1788940876.720507:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068580480 00000100:00100000:0.0:1788940876.720542:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788940876.720549:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14412:x1875840068580480:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788940876.720572:0:14424:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788940876.720586:0:14424:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788940876.789817:0:14424:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788940876.789841:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788940876.789905:0:14445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788940876.789912:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788940876.789936:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940876.789957:0:14445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3d43 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940876.789965:0:14445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940876.790021:0:14445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa3d43 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940876.790036:0:14445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d43 expref: 12 pid: 14424 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940876.790051:0:14445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1875840068580608:0@lo:104: 00000100:00100000:2.0:1788940876.790117:0:14445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940876.790174:0:14445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410f69acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940876.790359:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068580608 00000100:00100000:0.0:1788940876.790369:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068580608 00000100:00100000:0.0:1788940876.790408:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940876.790418:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a03ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:340eef01-7b53-49af-9aa3-2abb708ce8bb+3:14445:x1875840068580608:12345-0@lo:104: 00010000:00010000:0.0:1788940876.790441:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa3d4a expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.790498:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940876.790505:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a03ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:340eef01-7b53-49af-9aa3-2abb708ce8bb+3:14445:x1875840068580608:12345-0@lo:104: Request processed in 89us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940876.790511:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788940876.790531:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940876.790536:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa3d4a expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.790556:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7e00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:0.0:1788940876.790560:0:14419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa3d4a expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.790569:0:14419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa3d4a expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940876.790576:0:14419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa3d4a expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940876.790582:0:14419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940876.790610:0:14419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3d4a expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.790615:0:14419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940876.790631:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3d4a expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.790637:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7e00/0xa1d8aa9164aa3d43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3d4a expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940876.790655:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940876.790656:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940876.790658:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940876.790669:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:340eef01-7b53-49af-9aa3-2abb708ce8bb:3302:1875840068580736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940876.790700:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940876.790970:0:14445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1875840068580608:0@lo:104: 00010000:00010000:2.0:1788940876.791002:0:14445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940876.792389:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068580736 00000100:00100000:1.0:1788940876.792401:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068580736 00010000:00010000:1.0:1788940876.792444:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d43 expref: 13 pid: 14424 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940876.792522:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940876.792531:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:340eef01-7b53-49af-9aa3-2abb708ce8bb+13:3302:x1875840068580736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940876.792545:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940876.792551:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d43 expref: 13 pid: 14424 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.792563:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d43 expref: 13 pid: 14424 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.792580:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d43 expref: 13 pid: 14424 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.792610:0:14415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.792618:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788940876.792633:0:14415:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002722472s 00010000:00010000:1.0:1788940876.792638:0:14415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.792645:0:14415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.792652:0:14415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.792658:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.792664:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940876.792668:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.792676:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.792697:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940876.792708:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788940876.792907:0:14445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940876.792916:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940876.792922:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc6c00/0xa1d8aa9164aa3d7b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940876.792963:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:3302:x1875840068580736:12345-0@lo:103:ldlm_bl.0 Request processed in 432us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940876.792970:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940876.796493:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:340eef01-7b53-49af-9aa3-2abb708ce8bb:3302:1875840068580736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940876.801705:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+11:14412:x1875840068580480:12345-0@lo:253:mount.lustre.0 Request processed in 81146us (81470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940876.801737:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788940876.801950:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:14412:1875840068580480:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788940876.801966:0:14412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788940876.801971:0:14412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788940876.801972:0:14412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788940876.801974:0:14412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788940876.801975:0:14412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788940876.801976:0:14412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788940876.801977:0:14412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788940876.801979:0:14412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788940876.801980:0:14412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788940876.801982:0:14412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788940876.801984:0:14412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788940876.802067:0:14412:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788940876.809433:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940876.809621:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788940876.810110:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940876.810477:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788940876.810925:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940876.811447:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788940876.812982:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788940876.813442:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788940876.813742:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940876.814610:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788940876.814910:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940876.815280:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788940876.855734:0:14412:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788940876.856351:0:14412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788940876.856684:0:14467:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788940876.856689:0:14467:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788940876.856770:0:14468:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788940876.856905:0:14468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940876.861912:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788940876.861980:0:14468:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788940876.862052:0:14468:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788940876.862478:0:14412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788940876.862607:0:14412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788940876.863497:0:14412:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788940876.863508:0:14412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788940876.863657:0:14412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940876.865497:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788940876.867053:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788940876.867105:0:14412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788940876.867748:0:14412:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1788940876.868933:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788940876.875864:0:14412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788940876.910137:0:14412:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788940876.910175:0:14412:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa0d581c2f988 00100000:10000000:1.0:1788940876.910184:0:14412:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788940876.911650:0:14412:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788940876.911669:0:14412:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.117@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788940876.911685:0:14412:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788940876.911714:0:14412:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788940877.321361:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788940877.774317:0:14463:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788940877.774328:0:14463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940877.774757:0:14463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1788940877.774765:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1788940877.832357:0:14427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788940877.832365:0:14427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f4002627000 from 6 10000000:01000000:0.0:1788940877.832382:0:14427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788940877.832442:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.832456:0:14427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.832468:0:14427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940877.832494:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068580864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940877.832561:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940877.832643:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41071a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788940877.832819:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068580864 00000100:00100000:3.0:1788940877.832835:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068580864 00000100:00100000:3.0:1788940877.833034:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788940877.833045:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+11:14427:x1875840068580864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940877.833058:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940877.833073:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4140f42600/0xa1d8aa9164aa3d89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3d82 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.833098:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4140f42600/0xa1d8aa9164aa3d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3d82 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.833110:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4140f42600/0xa1d8aa9164aa3d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3d82 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940877.833118:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4140f42600, rc 0) 00000100:00100000:3.0:1788940877.833165:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14427:x1875840068580864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940877.833172:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788940877.833805:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068580864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940877.833825:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3d89 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940877.833834:0:14427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3d89 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940877.833895:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068580992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788940877.833930:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940877.833970:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41071a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788940877.834404:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068580992 00000100:00100000:1.0:1788940877.834429:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068580992 00000100:00100000:1.0:1788940877.834465:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788940877.834474:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14427:x1875840068580992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788940877.834489:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788940877.834504:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788940877.834506:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788940877.834589:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14427:x1875840068580992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940877.834595:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788940877.834629:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068580992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788940877.834673:0:14427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788940877.834692:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3d89 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940877.834701:0:14427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3d89 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940878.344640:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788940878.794568:0:14463:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788940878.794579:0:14463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940878.795105:0:14463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788940878.795163:0:14463:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940878.795225:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:0.0:1788940879.369736:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940880.395953:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940881.428349:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940881.930589:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940881.930596:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788940881.930606:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940881.930609:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788940881.930612:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788940881.930615:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788940881.930618:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f4139f92800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940881.930636:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f4139f92800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:0.0:1788940881.930659:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f40039c4000 x1875840068581248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940881.930708:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:340eef01-7b53-49af-9aa3-2abb708ce8bb:3303:1875840068581120:0@lo:400:kworker.0 00000100:00100000:0.0:1788940881.930773:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940881.930824:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875840068581248:0@lo:38:kworker.0 00000100:00100000:0.0:1788940881.930854:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940881.930894:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068581248 00000100:00100000:0.0:1788940881.930902:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068581248 00000100:00100000:0.0:1788940881.930932:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940881.930939:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3300:x1875840068581248:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788940881.930963:0:14431:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:0.0:1788940881.931002:0:14431:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa1d8aa9164aa3d90 00000004:00100000:0.0:1788940881.931018:0:14431:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788940881.931160:0:14431:0:(import.c:65:import_set_state_nolock()) ffff8f413f180000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940881.931228:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875840068581248:12345-0@lo:38:kworker.0 Request processed in 288us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940881.931236:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788940881.931284:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f40039c4000 x1875840068581248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788940881.931307:0:3300:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788940881.931315:0:3300:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788940881.931320:0:3300:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788940881.931323:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f4139f92800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788940881.931329:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875840068581248:0@lo:38:kworker.0 00000100:00100000:1.0:1788940881.931621:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068581120 00000100:00100000:1.0:1788940881.931627:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068581120 00000100:00100000:1.0:1788940881.931660:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940881.931669:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:3303:x1875840068581120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940881.931715:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:3303:x1875840068581120:12345-0@lo:400:kworker.0 Request processed in 46us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940881.931721:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788940881.932010:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:340eef01-7b53-49af-9aa3-2abb708ce8bb:3303:1875840068581120:0@lo:400:kworker.0 00000001:02000400:2.0:1788940882.090045:0:14712:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg217-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788940882.452125:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940883.464593:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940884.488411:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940885.516768:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940886.031299:0:3300:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940876/real 1788940876] req@ffff8f40039c6d80 x1875840068578432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940886 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940886.031331:0:3300:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f40039c6d80 x1875840068578432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940886 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940886.031354:0:3300:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940876/real 1788940876] req@ffff8f4002db5880 x1875840068578304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940886 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940886.031366:0:3300:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f4002db5880 x1875840068578304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940886 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788940886.031385:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f410f4f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940886.031454:0:3300:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788940886.031459:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068578432:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788940886.031466:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f4134e53800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940886.037276:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940886.037283:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788940886.037287:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f4134e53800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940886.037295:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:0.0:1788940886.037301:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788940886.037315:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f4134e53800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:0.0:1788940886.037353:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f40039c5f80 x1875840068581504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940886.037367:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788940886.037370:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788940886.037372:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f410f4f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940886.037375:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:0.0:1788940886.037378:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788940886.037382:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f410f4f3800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:0.0:1788940886.037393:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f40039c5880 x1875840068581632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940886.037430:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068581760:0@lo:400:kworker.0 00000100:00100000:0.0:1788940886.037504:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940886.037588:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068581760 00000100:00100000:0.0:1788940886.037596:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068581760 00000100:00100000:0.0:1788940886.037638:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940886.037646:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068581760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940886.037779:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940886.037790:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:340eef01-7b53-49af-9aa3-2abb708ce8bb:3303:1875840068581376:0@lo:400:kworker.0 00000100:00080000:3.0:1788940886.038267:0:3300:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788940886.038274:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068578304:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788940886.038298:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068581504:0@lo:8:kworker.0 00000100:00100000:1.0:1788940886.040258:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940886.040398:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068581376 00000100:00100000:2.0:1788940886.040409:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068581376 00000100:00100000:2.0:1788940886.040466:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788940886.040475:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:3303:x1875840068581376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940886.040539:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:3303:x1875840068581376:12345-0@lo:400:kworker.0 Request processed in 65us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940886.040546:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788940886.044511:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:340eef01-7b53-49af-9aa3-2abb708ce8bb:3303:1875840068581376:0@lo:400:kworker.0 00000100:00100000:0.0:1788940886.046350:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068581760:12345-0@lo:400:kworker.0 Request processed in 8687us (8830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940886.046365:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788940886.046431:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f40039c7100 x1875840068581760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940886.046444:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068581760:0@lo:400:kworker.0 00000400:00000100:3.0:1788940886.046537:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875840068581504 offset 0 length 520: 4 00000100:00100000:3.0:1788940886.046579:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068581632:0@lo:8:kworker.0 00000400:00000100:3.0:1788940886.046610:0:3300:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875840068581632 offset 0 length 520: 4 00000020:00000080:1.0:1788940886.092062:0:14863:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec26b0110 20000000:00000080:1.0:1788940886.092080:0:14863:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f4137994800 uarg=0000000000000000 20000000:01000000:1.0:1788940886.092117:0:14863:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788940886.092124:0:14863:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788940886.092129:0:14863:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788940886.093390:0:14864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788940886.093878:0:14863:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788940886.107914:0:14863:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788940886.110294:0:14863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940886.110320:0:14863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f41073d4c00/0xa1d8aa9164aa3d58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3d51 expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940886.110330:0:14863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940886.110386:0:14863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f41073d4c00/0xa1d8aa9164aa3d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa3d51 expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940886.110405:0:14863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f41073d4c00/0xa1d8aa9164aa3d58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d51 expref: 11 pid: 14423 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940886.110423:0:14863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14863:1875840068581888:0@lo:104: 00000100:00100000:0.0:1788940886.110507:0:14863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940886.110573:0:14863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003b15540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940886.110902:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068581888 00000100:00100000:2.0:1788940886.110922:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068581888 00000100:00100000:2.0:1788940886.110977:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940886.110989:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:340eef01-7b53-49af-9aa3-2abb708ce8bb+3:14863:x1875840068581888:12345-0@lo:104: 00010000:00010000:2.0:1788940886.111003:0:14414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa3d58 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111064:0:14414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788940886.111071:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:340eef01-7b53-49af-9aa3-2abb708ce8bb+3:14863:x1875840068581888:12345-0@lo:104: Request processed in 85us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940886.111077:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788940886.111099:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940886.111105:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa3d58 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111112:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f43200 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:2.0:1788940886.111117:0:14419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa3d58 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111137:0:14419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa3d58 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940886.111144:0:14419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa3d58 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940886.111149:0:14419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788940886.111181:0:14419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3d58 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111209:0:14419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788940886.111229:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3d58 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111237:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4140f43200/0xa1d8aa9164aa3d51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3d58 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111253:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940886.111254:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940886.111256:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940886.111274:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:340eef01-7b53-49af-9aa3-2abb708ce8bb:3302:1875840068582016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940886.111304:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940886.111362:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068582016 00000100:00100000:2.0:1788940886.111366:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068582016 00010000:00010000:2.0:1788940886.111383:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f41073d4c00/0xa1d8aa9164aa3d58 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d51 expref: 12 pid: 14423 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940886.111403:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940886.111410:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a039f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:3302:x1875840068582016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940886.111428:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940886.111434:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f41073d4c00/0xa1d8aa9164aa3d58 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d51 expref: 12 pid: 14423 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111443:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f41073d4c00/0xa1d8aa9164aa3d58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d51 expref: 12 pid: 14423 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111458:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111465:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111478:0:14416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111484:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111490:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111495:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111500:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030600 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940886.111504:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111510:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111527:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940886.111537:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940886.111570:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a039f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:3302:x1875840068582016:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940886.111577:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940886.111612:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:340eef01-7b53-49af-9aa3-2abb708ce8bb:3302:1875840068582016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940886.113387:0:14863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f41073d4c00/0xa1d8aa9164aa3d58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d51 expref: 11 pid: 14423 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940886.113403:0:14863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14863:1875840068581888:0@lo:104: 00010000:00010000:0.0:1788940886.113425:0:14863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940886.113436:0:14863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940886.113442:0:14863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940886.113447:0:14863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4100030600/0xa1d8aa9164aa3d97 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940886.538218:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788940887.368284:0:14427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940887.368290:0:14427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f4002627000 from 10 10000000:01000000:2.0:1788940887.368295:0:14427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940887.368350:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.368362:0:14427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.368374:0:14427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940887.368402:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068582144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940887.368482:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940887.368533:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41073cc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788940887.368675:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068582144 00000100:00100000:1.0:1788940887.368685:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068582144 00000100:00100000:1.0:1788940887.368747:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788940887.368756:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+11:14427:x1875840068582144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940887.368769:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940887.368783:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f41073d5600/0xa1d8aa9164aa3da5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3d9e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.368807:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f41073d5600/0xa1d8aa9164aa3da5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3d9e expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.368984:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f41073d5600/0xa1d8aa9164aa3da5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3d9e expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940887.368996:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5600, rc 0) 00000100:00100000:1.0:1788940887.369052:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14427:x1875840068582144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 297us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940887.369069:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788940887.369207:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068582144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940887.369224:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3da5 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.369235:0:14427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3da5 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940887.369289:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a695880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068582272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940887.369320:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940887.369348:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1eab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788940887.370049:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068582272 00000100:00100000:1.0:1788940887.370056:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068582272 00000100:00100000:1.0:1788940887.370094:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788940887.370102:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14427:x1875840068582272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940887.370387:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14427:x1875840068582272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940887.370395:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788940887.370431:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a695880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068582272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940887.370479:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068582400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940887.370519:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940887.370535:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410739dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788940887.370548:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068582400 00000100:00100000:1.0:1788940887.370552:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068582400 00000100:00100000:1.0:1788940887.370570:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788940887.370576:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14427:x1875840068582400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788940887.370930:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:14427:x1875840068582400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 352us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940887.370937:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788940887.375868:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068582400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788940887.385020:0:14908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788940887.385275:0:14427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788940887.385301:0:14427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788940887.385313:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3da5 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940887.385354:0:14427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3da5 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940887.560286:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940888.013584:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788940888.584453:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940889.611297:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940890.634513:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940891.144539:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:340eef01-7b53-49af-9aa3-2abb708ce8bb:3303:1875840068582528:0@lo:400:kworker.0 00000100:00100000:2.0:1788940891.144656:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940891.144738:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068582528 00000100:00100000:0.0:1788940891.144747:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068582528 00000100:00100000:0.0:1788940891.144798:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788940891.144808:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:3303:x1875840068582528:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788940891.144888:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940891.144893:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788940891.144895:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940891.144898:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788940891.144962:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068582656:0@lo:400:kworker.0 00000100:00100000:3.0:1788940891.144999:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940891.145036:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068582656 00000100:00100000:3.0:1788940891.145040:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068582656 00000100:00100000:3.0:1788940891.145070:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788940891.145076:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068582656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940891.145112:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068582656:12345-0@lo:400:kworker.0 Request processed in 36us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940891.145121:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788940891.145158:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f4002db4380 x1875840068582656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940907 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940891.145173:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068582656:0@lo:400:kworker.0 00000100:00100000:0.0:1788940891.146576:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:3303:x1875840068582528:12345-0@lo:400:kworker.0 Request processed in 1760us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940891.146764:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:340eef01-7b53-49af-9aa3-2abb708ce8bb:3303:1875840068582528:0@lo:400:kworker.0 00000100:00100000:0.0:1788940891.147419:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1788940891.657775:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788940891.845945:0:15112:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788940891.845949:0:15112:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788940891.846082:0:15112:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f4118039800 00000020:01000004:2.0:1788940891.846098:0:15112:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788940891.846110:0:15112:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788940891.846123:0:15112:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f4141298000) 00000020:00000080:2.0:1788940891.846140:0:15112:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788940891.865166:0:15112:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788940891.865488:0:15112:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788940891.872239:0:15112:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788940891.872537:0:15112:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788940891.872783:0:15112:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788940891.873208:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 555: rc = 0 00100000:10000000:2.0:1788940891.873322:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 555: rc = 0 00100000:10000000:2.0:1788940891.873417:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 555: rc = 0 00100000:10000000:2.0:1788940891.874899:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 770: rc = 0 00100000:10000000:2.0:1788940891.877133:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:2.0:1788940891.885751:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 770: rc = 0 00100000:10000000:2.0:1788940891.886041:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 770: rc = 0 00100000:10000000:2.0:1788940891.886371:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:2.0:1788940891.886627:0:15112:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 770: rc = 0 00000020:00000080:2.0:1788940891.887277:0:15112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788940891.887302:0:15112:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788940891.887314:0:15112:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa1d8aa9164aa3db3 00000020:01000004:2.0:1788940891.887326:0:15112:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788940891.887352:0:15112:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.117@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788940891.887357:0:15112:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788940891.887371:0:15112:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788940891.887377:0:15112:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788940891.887388:0:15112:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f414129b380) 00000020:00000080:2.0:1788940891.887400:0:15112:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788940891.904563:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940891.904758:0:15112:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788940891.904767:0:15112:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788940891.905684:0:15112:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788940891.905694:0:15112:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788940891.911390:0:15112:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788940891.914079:0:15112:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788940891.917462:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788940891.917655:0:15112:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788940891.917662:0:15112:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788940891.918805:0:15112:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788940891.918816:0:15112:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788940891.948406:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788940891.948651:0:15112:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788940891.948659:0:15112:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788940891.950996:0:15112:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788940891.951010:0:15112:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788940891.955942:0:15112:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788940891.955957:0:15112:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788940891.962881:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940891.963099:0:15112:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788940891.963105:0:15112:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788940891.972950:0:15112:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788940891.972973:0:15112:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788940892.038521:0:15112:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788940892.039529:0:15112:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788940892.039538:0:15112:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788940892.045416:0:15112:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788940892.045437:0:15112:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788940892.046406:0:15112:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788940892.046432:0:15112:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788940892.046439:0:15112:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.117@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788940892.089548:0:15112:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.117@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788940892.089599:0:15112:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.117@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788940892.089604:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788940892.089605:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940892.089607:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940892.089608:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940892.089609:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940892.089610:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940892.089612:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940892.089614:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940892.089615:0:15112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940892.089618:0:15112:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788940892.089626:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940892.089627:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940892.089628:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940892.089629:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940892.089630:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940892.089631:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940892.089632:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940892.089632:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940892.089633:0:15112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788940892.089658:0:15112:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788940892.089679:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068582784:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788940892.091609:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.091711:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41073cc000 going to sleep for 11 seconds 00000100:00100000:3.0:1788940892.095509:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068582784 00000100:00100000:3.0:1788940892.095527:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068582784 00000100:00100000:3.0:1788940892.095597:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788940892.095608:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:15112:x1875840068582784:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788940892.095643:0:14423:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788940892.095646:0:14423:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788940892.095650:0:14423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788940892.110477:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:15112:x1875840068582784:12345-0@lo:253:mount.lustre.0 Request processed in 14850us (18854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940892.110495:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788940892.110616:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068582784:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788940892.110644:0:15112:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788940892.110648:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940892.110649:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788940892.110651:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940892.110652:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940892.110653:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940892.110655:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940892.110656:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940892.110658:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940892.110659:0:15112:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788940892.110683:0:15112:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f4118039800 from lustre-OST0000 10000000:01000000:0.0:1788940892.110723:0:15112:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788940892.110726:0:15112:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788940892.110733:0:15112:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f41182899c0 local copy 00010000:00010000:0.0:1788940892.110742:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d4200/0xa1d8aa9164aa3ca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3cb0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940892.111118:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068582912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940892.111273:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940892.111322:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4107304780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940892.111479:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068582912 00000100:00100000:2.0:1788940892.111487:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068582912 00000100:00100000:2.0:1788940892.111533:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788940892.111543:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:15112:x1875840068582912:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940892.111847:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:15112:x1875840068582912:12345-0@lo:501:mount.lustre.0 Request processed in 304us (572us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788940892.111922:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788940892.112117:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068582912:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788940892.112134:0:15112:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788940892.112609:0:15112:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788940892.112619:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d4200/0xa1d8aa9164aa3ca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3cb0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.112761:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f41073d4200/0xa1d8aa9164aa3ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3cb0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940892.112787:0:15112:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f4118039800 10000000:01000000:0.0:1788940892.112793:0:15112:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788940892.112799:0:15112:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f41182899c0 10000000:01000000:0.0:1788940892.112801:0:15112:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788940892.112804:0:15112:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f41182899c0 from 1 10000000:01000000:0.0:1788940892.112807:0:15112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788940892.112837:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa3dc1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.112845:0:15112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa3dc1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.112916:0:15112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa3dc1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940892.112936:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788940892.112979:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940892.116202:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4107304780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940892.117097:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068583040 00000100:00100000:2.0:1788940892.117109:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068583040 00000100:00100000:2.0:1788940892.117339:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788940892.117350:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+12:15112:x1875840068583040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940892.117367:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940892.117387:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6a00/0xa1d8aa9164aa3dc8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3dc1 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.117431:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6a00/0xa1d8aa9164aa3dc8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3dc1 expref: 13 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.117442:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc6a00/0xa1d8aa9164aa3dc8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3dc1 expref: 13 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.117461:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6a00, rc 0) 00000100:00100000:2.0:1788940892.117540:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+13:15112:x1875840068583040:12345-0@lo:101:mount.lustre.0 Request processed in 192us (4561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940892.117546:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788940892.117722:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583040:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940892.117740:0:15112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa3dc1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3dc8 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940892.117750:0:15112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa3dc1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3dc8 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940892.117773:0:15112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788940892.117790:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa3dc1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3dc8 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940892.117799:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4100030600/0xa1d8aa9164aa3dc1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3dc8 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940892.117808:0:15112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788940892.117813:0:15112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940892.117820:0:15112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788940892.117822:0:15112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788940892.117845:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d5200/0xa1d8aa9164aa3dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940892.117860:0:15112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f41073d5200/0xa1d8aa9164aa3dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940892.117869:0:15112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f41073d5200/0xa1d8aa9164aa3dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940892.117895:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940892.117928:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940892.117962:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4112bbb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940892.118335:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068583168 00000100:00100000:2.0:1788940892.118341:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068583168 00000100:00100000:2.0:1788940892.118387:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788940892.118395:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+13:15112:x1875840068583168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940892.118405:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940892.118418:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa3dd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3dcf expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.118433:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa3dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3dcf expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.118442:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc6000/0xa1d8aa9164aa3dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3dcf expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.118449:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6000, rc 0) 00000100:00100000:2.0:1788940892.118673:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+14:15112:x1875840068583168:12345-0@lo:101:mount.lustre.0 Request processed in 278us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940892.118691:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788940892.121414:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788940892.121533:0:15112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f41073d5200/0xa1d8aa9164aa3dcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3dd6 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940892.121547:0:15112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f41073d5200/0xa1d8aa9164aa3dcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3dd6 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940892.122859:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788940892.124823:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940892.125132:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788940892.125179:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788940892.125251:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788940892.125317:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788940892.125355:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788940892.125390:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788940892.125456:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788940892.125465:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788940892.125568:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940892.125636:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.125673:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a5b8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940892.126003:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068583296 00000100:00100000:0.0:1788940892.126012:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068583296 00000100:00100000:0.0:1788940892.126067:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788940892.126077:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+14:15112:x1875840068583296:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940892.126499:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+14:15112:x1875840068583296:12345-0@lo:501:mount.lustre.0 Request processed in 422us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.126507:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788940892.129398:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940892.129544:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940892.129643:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.129685:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a5b8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940892.129853:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068583424 00000100:00100000:0.0:1788940892.129867:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068583424 00000100:00100000:0.0:1788940892.129927:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788940892.129936:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+14:15112:x1875840068583424:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940892.130347:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+14:15112:x1875840068583424:12345-0@lo:503:mount.lustre.0 Request processed in 411us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.130355:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788940892.131841:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583424:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788940892.134179:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788940892.134431:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940892.134523:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.134566:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a5b8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940892.134712:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068583552 00000100:00100000:3.0:1788940892.134720:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068583552 00000100:00100000:3.0:1788940892.134772:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788940892.134782:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+14:15112:x1875840068583552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940892.135036:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+14:15112:x1875840068583552:12345-0@lo:502:mount.lustre.0 Request processed in 254us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940892.135045:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788940892.135267:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940892.135535:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788940892.135587:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788940892.135631:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788940892.135677:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788940892.138256:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788940892.138332:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788940892.138438:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788940892.144018:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788940892.144072:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788940892.144149:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788940892.144214:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788940892.144272:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788940892.144359:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940892.144456:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.144497:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a5b8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940892.144587:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068583680 00000100:00100000:3.0:1788940892.144596:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068583680 00000100:00100000:3.0:1788940892.144662:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788940892.144673:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+14:15112:x1875840068583680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940892.144894:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+14:15112:x1875840068583680:12345-0@lo:502:mount.lustre.0 Request processed in 223us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940892.144902:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788940892.145548:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583680:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940892.145660:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788940892.145673:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788940892.148754:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788940892.148765:0:15126:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788940892.148772:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940892.148775:0:15126:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788940892.148782:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788940892.148798:0:15126:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f414129cd40) 00000020:00000080:2.0:1788940892.148823:0:15126:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788940892.148828:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788940892.148907:0:15126:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f4118039800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788940892.148915:0:15126:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788940892.148922:0:15126:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa1d8aa9164aa3de4 00010000:00010000:2.0:1788940892.152062:0:15126:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788940892.157602:0:15126:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788940892.161390:0:15126:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788940892.169985:0:15126:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788940892.169998:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940892.170004:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940892.170006:0:15126:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788940892.170009:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788940892.170012:0:15126:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788940892.170014:0:15126:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788940892.170016:0:15126:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788940892.170017:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788940892.170019:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940892.170021:0:15126:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788940892.170023:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940892.170026:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940892.170027:0:15126:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788940892.170030:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788940892.170031:0:15126:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788940892.170033:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940892.170035:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940892.170036:0:15126:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788940892.170038:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788940892.170040:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940892.170041:0:15126:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788940892.170044:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788940892.170105:0:15126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788940892.170108:0:15126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940892.170109:0:15126:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788940892.170112:0:15126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788940892.179379:0:15112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788940892.179426:0:15112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788940892.179457:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d5200/0xa1d8aa9164aa3dcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3dd6 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.179481:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f41073d5200/0xa1d8aa9164aa3dcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3dd6 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940892.179490:0:15112:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f4118039800 from 1 10000000:01000000:2.0:1788940892.179492:0:15112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940892.179528:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.179536:0:15112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.179548:0:15112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940892.179572:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788940892.179648:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.180564:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a5b8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940892.181668:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068583808 00000100:00100000:0.0:1788940892.181681:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068583808 00000100:00100000:0.0:1788940892.181755:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788940892.181765:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+14:15112:x1875840068583808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940892.181788:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940892.181811:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa3df2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3deb expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.182100:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa3df2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3deb expref: 15 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.182113:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa3df2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3deb expref: 15 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.182123:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100031000, rc 0) 00000100:00100000:0.0:1788940892.182234:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+15:15112:x1875840068583808:12345-0@lo:101:mount.lustre.0 Request processed in 471us (2586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.182241:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788940892.183138:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940892.183173:0:15112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3df2 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.183184:0:15112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3df2 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940892.184961:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788940892.186100:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940892.186401:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788940892.186444:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788940892.186828:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788940892.186838:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788940892.186991:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940892.187051:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.187090:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a5b8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788940892.187214:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068583936 00000100:00100000:3.0:1788940892.187223:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068583936 00000100:00100000:3.0:1788940892.187270:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788940892.187290:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+15:15112:x1875840068583936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940892.187530:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+15:15112:x1875840068583936:12345-0@lo:501:mount.lustre.0 Request processed in 251us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940892.187544:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788940892.187982:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068583936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940892.188017:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940892.188059:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.188118:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a5b8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940892.188829:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068584064 00000100:00100000:0.0:1788940892.188838:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068584064 00000100:00100000:0.0:1788940892.188978:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940892.188989:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+15:15112:x1875840068584064:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940892.189407:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+15:15112:x1875840068584064:12345-0@lo:503:mount.lustre.0 Request processed in 419us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.189417:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788940892.189652:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584064:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788940892.190231:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788940892.190312:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940892.190361:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.190916:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a5b8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940892.191568:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068584192 00000100:00100000:0.0:1788940892.191577:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068584192 00000100:00100000:0.0:1788940892.191615:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940892.191624:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+15:15112:x1875840068584192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940892.197567:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+15:15112:x1875840068584192:12345-0@lo:502:mount.lustre.0 Request processed in 5931us (7192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.197583:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788940892.198001:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940892.198372:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788940892.198435:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788940892.198501:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788940892.198580:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788940892.198653:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788940892.198715:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788940892.198751:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788940892.198785:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788940892.198828:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940892.198892:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.198932:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a5b8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940892.199435:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068584320 00000100:00100000:0.0:1788940892.199443:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068584320 00000100:00100000:0.0:1788940892.199494:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788940892.199503:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+15:15112:x1875840068584320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940892.199738:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+15:15112:x1875840068584320:12345-0@lo:502:mount.lustre.0 Request processed in 235us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.199746:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788940892.200390:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940892.200529:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788940892.200543:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788940892.202119:0:15130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940892.202132:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940892.202134:0:15130:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788940892.202142:0:15130:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f4118039800 00000020:00000080:3.0:1788940892.202144:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788940892.202153:0:15130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940892.202155:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940892.202157:0:15130:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788940892.202159:0:15130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940892.202161:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940892.202163:0:15130:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788940892.202165:0:15130:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f4118039800 00000020:00000080:3.0:1788940892.202167:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788940892.202355:0:15130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940892.202359:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940892.202361:0:15130:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788940892.202364:0:15130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940892.202367:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940892.202368:0:15130:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788940892.202371:0:15130:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f4118039800 00000020:00000080:3.0:1788940892.202374:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788940892.218959:0:15130:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940892.218975:0:15130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940892.218978:0:15130:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788940892.218987:0:15130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788940892.219530:0:15112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788940892.219573:0:15112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940892.219590:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3df2 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.219603:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3df2 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940892.219667:0:15112:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788940892.219670:0:15112:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f4118039800 10000000:01000000:0.0:1788940892.219682:0:15112:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f4118039800 10000000:01000000:0.0:1788940892.219686:0:15112:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788940892.219694:0:15112:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f4118039800 from 1 10000000:01000000:0.0:1788940892.219696:0:15112:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788940892.219737:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa3df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.219747:0:15112:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa3df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.219759:0:15112:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa3df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940892.219786:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788940892.219870:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940892.219915:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068584448 00000100:00100000:0.0:1788940892.219922:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068584448 00000100:00100000:0.0:1788940892.219961:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788940892.219970:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+15:15112:x1875840068584448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940892.219983:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940892.219996:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4100030800/0xa1d8aa9164aa3e00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3df9 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.220019:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4100030800/0xa1d8aa9164aa3e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3df9 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.220029:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4100030800/0xa1d8aa9164aa3e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3df9 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.220038:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4100030800, rc 0) 00000100:00100000:0.0:1788940892.220077:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15112:x1875840068584448:12345-0@lo:101:mount.lustre.0 Request processed in 108us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.220084:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788940892.220128:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411133bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940892.220161:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940892.220176:0:15112:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa3df9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3e00 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.220205:0:15112:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa3df9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3e00 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940892.220779:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788940892.221378:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940892.221654:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788940892.221698:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788940892.221731:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788940892.221825:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788940892.221864:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788940892.221914:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788940892.221949:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788940892.221979:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788940892.222023:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788940892.222061:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788940892.222097:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788940892.222147:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788940892.222183:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788940892.222266:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788940892.222334:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788940892.222374:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788940892.222440:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788940892.222492:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788940892.222531:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788940892.222560:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788940892.222599:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788940892.222632:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788940892.222666:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788940892.222711:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788940892.222747:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788940892.222780:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788940892.222821:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788940892.222854:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788940892.222930:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788940892.222938:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788940892.223038:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940892.223099:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940892.223155:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068584576 00000100:00100000:0.0:1788940892.223162:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068584576 00000100:00100000:0.0:1788940892.223226:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788940892.223235:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15112:x1875840068584576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940892.223614:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f411133bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788940892.249337:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15112:x1875840068584576:12345-0@lo:501:mount.lustre.0 Request processed in 26092us (26227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.249352:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788940892.249684:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940892.249753:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940892.249810:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.249857:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4115c4e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788940892.249979:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068584704 00000100:00100000:0.0:1788940892.249987:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068584704 00000100:00100000:0.0:1788940892.250029:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788940892.250038:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15112:x1875840068584704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788940892.250346:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15112:x1875840068584704:12345-0@lo:503:mount.lustre.0 Request processed in 308us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.250355:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788940892.250461:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584704:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788940892.250998:0:15112:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788940892.251081:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940892.251131:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.251169:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41034c1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788940892.251355:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068584832 00000100:00100000:0.0:1788940892.251362:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068584832 00000100:00100000:0.0:1788940892.251397:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788940892.251406:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15112:x1875840068584832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940892.251676:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15112:x1875840068584832:12345-0@lo:502:mount.lustre.0 Request processed in 270us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.251683:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788940892.251994:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940892.252347:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788940892.252400:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788940892.252435:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788940892.252486:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788940892.252526:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788940892.252592:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788940892.252703:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788940892.252746:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788940892.252796:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788940892.252837:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788940892.252870:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788940892.252917:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788940892.252951:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788940892.252980:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788940892.253056:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788940892.253108:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788940892.253139:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788940892.253181:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788940892.253248:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788940892.253293:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788940892.253343:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788940892.253378:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788940892.253414:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788940892.253464:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788940892.253499:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788940892.253534:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788940892.253581:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788940892.253616:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788940892.259011:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788940892.259117:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788940892.259148:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788940892.259227:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788940892.259261:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788940892.261756:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788940892.261813:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788940892.261860:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788940892.261894:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788940892.261924:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788940892.261970:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788940892.262008:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788940892.262062:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940892.262163:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.262259:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4115c4e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788940892.264079:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068584960 00000100:00100000:1.0:1788940892.264100:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068584960 00000100:00100000:1.0:1788940892.264156:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788940892.264165:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15112:x1875840068584960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940892.264491:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15112:x1875840068584960:12345-0@lo:502:mount.lustre.0 Request processed in 326us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940892.264499:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788940892.268062:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068584960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788940892.268254:0:15112:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788940892.268269:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788940892.283452:0:15135:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788940892.283476:0:15135:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f412b3099c0) 00000020:00000080:0.0:1788940892.283501:0:15135:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788940892.284006:0:15135:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f4118039800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788940892.284012:0:15135:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f4118039800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788940892.284015:0:15135:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f4118039800 3 00010000:00080000:0.0:1788940892.284049:0:15135:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f411876d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.117@tcp at head 00010000:00010000:0.0:1788940892.288101:0:15135:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788940892.289061:0:15135:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788940892.289105:0:15135:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788940892.289117:0:15135:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa1d8aa9164aa3e0e 00000100:00080000:0.0:1788940892.289129:0:15135:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788940892.289141:0:15135:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f411876d800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:0.0:1788940892.289215:0:15135:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f40039c7800 x1875840068585088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788940892.289238:0:15135:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788940892.289275:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940892.289290:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788940892.289293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940892.289296:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788940892.290266:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068585216:0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.290345:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940892.290483:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068585216 00000100:00100000:0.0:1788940892.290490:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068585216 00000100:00100000:0.0:1788940892.290545:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940892.290567:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068585216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940892.290623:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068585216:12345-0@lo:400:kworker.0 Request processed in 58us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.290702:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788940892.290744:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f4002db7480 x1875840068585216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940892.290758:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068585216:0@lo:400:kworker.0 00000100:00100000:3.0:1788940892.290924:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1875840068585088:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788940892.290974:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788940892.291241:0:15135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1788940892.291249:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068585088 00000100:00100000:0.0:1788940892.291254:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068585088 00000100:00100000:0.0:1788940892.291274:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940892.291291:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3300:x1875840068585088:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788940892.291326:0:14430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1788940892.291363:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa1d8aa9164aa3e15 00000004:00100000:0.0:1788940892.291379:0:14430:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788940892.291586:0:14430:0:(import.c:65:import_set_state_nolock()) ffff8f41414f8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940892.291942:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875840068585088:12345-0@lo:38:llog_process_th.0 Request processed in 648us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.291951:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788940892.292034:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f40039c7800 x1875840068585088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940892.292044:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788940892.292051:0:3300:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788940892.292058:0:3300:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788940892.292062:0:3300:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788940892.292065:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f411876d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788940892.292071:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3300:1875840068585088:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788940892.294121:0:15112:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788940892.294213:0:15112:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788940892.294233:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa3df9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3e00 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.294254:0:15112:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4100030a00/0xa1d8aa9164aa3df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3e00 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788940892.294325:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788940892.294327:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940892.294329:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940892.294331:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940892.294332:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940892.294334:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940892.294335:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940892.294337:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940892.294339:0:15112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940892.294343:0:15112:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788940892.294346:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788940892.294347:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940892.294349:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940892.294350:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940892.294351:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940892.294352:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940892.294353:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940892.294354:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940892.294356:0:15112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788940892.294383:0:15112:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788940892.294416:0:15112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068585344:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788940892.294485:0:15112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940892.294527:0:15112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41034c1780 going to sleep for 11 seconds 00000100:00100000:2.0:1788940892.295255:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068585344 00000100:00100000:2.0:1788940892.295265:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068585344 00000100:00100000:2.0:1788940892.295330:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788940892.295341:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15112:x1875840068585344:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788940892.295391:0:14422:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788940892.295415:0:14422:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788940892.342570:0:14422:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788940892.342588:0:14422:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788940892.342603:0:14445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788940892.342609:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788940892.342635:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940892.342658:0:14445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4140f42600/0xa1d8aa9164aa3d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3d82 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940892.342668:0:14445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940892.342778:0:14445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4140f42600/0xa1d8aa9164aa3d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa3d82 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940892.342795:0:14445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f4140f42600/0xa1d8aa9164aa3d89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d82 expref: 16 pid: 14423 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940892.342810:0:14445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a697100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1875840068585472:0@lo:104: 00000100:00100000:3.0:1788940892.342888:0:14445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940892.342944:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068585472 00000100:00100000:1.0:1788940892.342952:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068585472 00000100:00100000:1.0:1788940892.343000:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940892.343009:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:340eef01-7b53-49af-9aa3-2abb708ce8bb+3:14445:x1875840068585472:12345-0@lo:104: 00010000:00010000:1.0:1788940892.343023:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa3d89 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940892.343093:0:14445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4110582b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788940892.343227:0:14445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a697100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1875840068585472:0@lo:104: 00010000:00010000:1.0:1788940892.343233:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940892.343240:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a696680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:340eef01-7b53-49af-9aa3-2abb708ce8bb+3:14445:x1875840068585472:12345-0@lo:104: Request processed in 231us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940892.343247:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788940892.343252:0:14445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.343589:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940892.343595:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa3d89 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.343601:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030c00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:0.0:1788940892.343604:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa3d89 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.343610:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa3d89 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940892.343621:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa3d89 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940892.343631:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788940892.343661:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3d89 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.343668:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940892.343698:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3d89 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.343705:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f4100030c00/0xa1d8aa9164aa3d82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3d89 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.343721:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940892.343722:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940892.343724:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940892.343756:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940892.343769:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:340eef01-7b53-49af-9aa3-2abb708ce8bb:3301:1875840068585600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940892.343804:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940892.343844:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068585600 00000100:00100000:0.0:1788940892.343914:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068585600 00010000:00010000:0.0:1788940892.343939:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4140f42600/0xa1d8aa9164aa3d89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d82 expref: 17 pid: 14423 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940892.344056:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940892.344063:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a697100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:3301:x1875840068585600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940892.344072:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940892.344075:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4140f42600/0xa1d8aa9164aa3d89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d82 expref: 17 pid: 14423 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.344083:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4140f42600/0xa1d8aa9164aa3d89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d82 expref: 17 pid: 14423 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.344097:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4140f42600/0xa1d8aa9164aa3d89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d82 expref: 17 pid: 14423 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.344106:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.344112:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788940892.344122:0:14416:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002722472s 00010000:00010000:0.0:1788940892.344125:0:14416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.344130:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.344134:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.344138:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.344141:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f42400 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940892.344143:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.344148:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.344167:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940892.344183:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940892.344241:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a697100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:3301:x1875840068585600:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940892.344247:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788940892.344298:0:14445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.344303:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940892.344308:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4140f42400/0xa1d8aa9164aa3e1c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940892.344363:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:340eef01-7b53-49af-9aa3-2abb708ce8bb:3301:1875840068585600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940892.348227:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+15:15112:x1875840068585344:12345-0@lo:253:mount.lustre.0 Request processed in 52877us (53730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940892.348241:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788940892.348373:0:15112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15112:1875840068585344:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788940892.348391:0:15112:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788940892.348404:0:15112:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788940892.348406:0:15112:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788940892.348408:0:15112:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788940892.348409:0:15112:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788940892.348411:0:15112:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788940892.348412:0:15112:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788940892.348414:0:15112:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788940892.348415:0:15112:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788940892.348416:0:15112:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788940892.348432:0:15112:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788940892.353791:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940892.353979:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788940892.354575:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940892.354801:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788940892.354954:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788940892.355161:0:15112:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788940892.356895:0:15112:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788940892.461263:0:15112:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788940892.461285:0:15112:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788940892.461328:0:15112:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788940892.462329:0:15112:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.117@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788940892.462372:0:15112:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788940892.462474:0:15112:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788940892.680587:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940893.710425:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788940893.771498:0:14427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788940893.771506:0:14427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f4002627000 from 7 10000000:01000000:2.0:1788940893.771512:0:14427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788940893.771559:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940893.771571:0:14427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940893.771581:0:14427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940893.771607:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068585728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940893.771736:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940893.771782:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1ea000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940893.771802:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068585728 00000100:00100000:2.0:1788940893.771808:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068585728 00000100:00100000:2.0:1788940893.771854:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788940893.771863:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+15:14427:x1875840068585728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940893.771876:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940893.771888:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc7000/0xa1d8aa9164aa3e2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3e23 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940893.771912:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc7000/0xa1d8aa9164aa3e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3e23 expref: 16 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940893.771923:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc7000/0xa1d8aa9164aa3e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3e23 expref: 16 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940893.771942:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7000, rc 0) 00000100:00100000:2.0:1788940893.771980:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:14427:x1875840068585728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940893.772941:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788940893.773068:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068585728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940893.773086:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3e2a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940893.773096:0:14427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3e2a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940893.773147:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068585856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788940893.773183:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940893.773235:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413f1ea000 going to sleep for 11 seconds 00000100:00100000:1.0:1788940893.773541:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068585856 00000100:00100000:1.0:1788940893.773548:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068585856 00000100:00100000:1.0:1788940893.773596:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788940893.773605:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:14427:x1875840068585856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788940893.774470:0:14422:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788940893.774490:0:14422:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788940893.774493:0:14422:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788940893.774594:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:14427:x1875840068585856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 990us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940893.774603:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788940893.774765:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068585856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788940893.774827:0:14427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788940893.774836:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3e2a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940893.774848:0:14427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3e2a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940894.730142:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940895.752444:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940896.777786:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940897.802511:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788940897.805542:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940897.805549:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788940897.805553:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788940897.805556:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788940897.805628:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068586112:0@lo:400:kworker.0 00000100:00100000:3.0:1788940897.805700:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940897.805754:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940897.805761:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:340eef01-7b53-49af-9aa3-2abb708ce8bb:3304:1875840068585984:0@lo:400:kworker.0 00000100:00100000:3.0:1788940897.805792:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940897.805821:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068586240:0@lo:400:kworker.0 00000100:00100000:3.0:1788940897.805858:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940897.805911:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068586112 00000100:00100000:3.0:1788940897.805920:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068586112 00000100:00100000:3.0:1788940897.806178:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068586240 00000100:00100000:3.0:1788940897.806183:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068586240 00000100:00100000:3.0:1788940897.806247:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940897.806256:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068586112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940897.806389:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068586112:12345-0@lo:400:kworker.0 Request processed in 134us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940897.806397:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940897.806415:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940897.806422:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068586240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940897.806456:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068586240:12345-0@lo:400:kworker.0 Request processed in 35us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940897.806462:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788940897.806498:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788940897.806526:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f413a696300 x1875840068586240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940897.806541:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a696300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068586240:0@lo:400:kworker.0 00010000:00080000:3.0:1788940897.806587:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f413a697480 x1875840068586112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940897.806597:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a697480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068586112:0@lo:400:kworker.0 00000100:00100000:2.0:1788940897.807270:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068585984 00000100:00100000:2.0:1788940897.807277:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068585984 00000100:00100000:2.0:1788940897.807353:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788940897.807367:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:3304:x1875840068585984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940897.807425:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:3304:x1875840068585984:12345-0@lo:400:kworker.0 Request processed in 59us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940897.807431:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788940897.807598:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:340eef01-7b53-49af-9aa3-2abb708ce8bb:3304:1875840068585984:0@lo:400:kworker.0 00000040:00080000:2.0:1788940898.249801:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788940898.825150:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940899.848340:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788940899.863429:0:15479:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg217-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788940900.875017:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940901.514985:0:3300:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940886/real 1788940886] req@ffff8f40039c5f80 x1875840068581504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940901 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940901.515032:0:3300:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f40039c5f80 x1875840068581504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940901 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940901.515044:0:3300:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940886/real 1788940886] req@ffff8f40039c5880 x1875840068581632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940901 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940901.515091:0:3300:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f40039c5880 x1875840068581632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788940901 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788940901.515115:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f4134e53800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940901.515143:0:3300:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788940901.515148:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068581504:0@lo:8:kworker.0 00000100:00080000:3.0:1788940901.515154:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f410f4f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940901.515160:0:3300:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788940901.515163:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068581632:0@lo:8:kworker.0 00000100:00080000:1.0:1788940901.515416:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940901.515421:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788940901.515425:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f4134e53800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940901.515430:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 527 00000100:00080000:1.0:1788940901.515437:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788940901.515450:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f4134e53800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:1.0:1788940901.515472:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4002db7b80 x1875840068586496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940901.515487:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788940901.515490:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788940901.515492:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f410f4f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940901.515495:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 527 00000100:00080000:1.0:1788940901.515498:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788940901.515501:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f410f4f3800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:1.0:1788940901.515517:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f4002db7800 x1875840068586624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940901.515652:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068586880:0@lo:400:kworker.0 00000100:00100000:1.0:1788940901.515741:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940901.515812:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788940901.515818:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068586752:0@lo:400:kworker.0 00000100:00100000:1.0:1788940901.515846:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940901.515900:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068586880 00000100:00100000:1.0:1788940901.515909:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068586880 00000100:00100000:1.0:1788940901.515969:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068586752 00000100:00100000:1.0:1788940901.515971:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068586752 00000100:00100000:1.0:1788940901.515987:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940901.515996:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068586880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940901.516048:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068586880:12345-0@lo:400:kworker.0 Request processed in 53us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940901.516056:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940901.516074:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940901.516080:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068586752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940901.516105:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875840068586752:12345-0@lo:400:kworker.0 Request processed in 25us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940901.516110:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788940901.516130:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788940901.516159:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4002db7480 x1875840068586752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940901.516172:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875840068586752:0@lo:400:kworker.0 00010000:00080000:1.0:1788940901.516181:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4002db6a00 x1875840068586880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940901.516253:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068586880:0@lo:400:kworker.0 00000100:00100000:1.0:1788940901.516274:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068586496:0@lo:8:kworker.0 00000100:00100000:1.0:1788940901.516305:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940901.516328:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068586624:0@lo:8:kworker.0 00000100:00100000:1.0:1788940901.516350:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940901.516383:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068586496 00000100:00100000:1.0:1788940901.516387:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068586496 00000100:00100000:1.0:1788940901.516411:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068586624 00000100:00100000:1.0:1788940901.516413:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068586624 00000100:00100000:1.0:1788940901.516422:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940901.516427:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1875840068586496:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788940901.516454:0:15114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:1.0:1788940901.516483:0:15114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa1d8aa9164aa3e31 00002000:00100000:1.0:1788940901.516499:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f4112976000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788940901.516504:0:15114:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788940901.516507:0:15114:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788940901.516911:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788940901.516941:0:15114:0:(import.c:65:import_set_state_nolock()) ffff8f4112972800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940901.516992:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875840068586496:12345-0@lo:8:kworker.0 Request processed in 563us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940901.517000:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940901.517017:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940901.517022:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1875840068586624:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788940901.517034:0:15114:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788940901.517070:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3300:x1875840068586624:12345-0@lo:8:kworker.0 Request processed in 47us (719us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788940901.517076:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788940901.517114:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4002db7b80 x1875840068586496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940901.517124:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788940901.517132:0:3300:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788940901.517141:0:3300:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788940901.517147:0:3300:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788940901.517149:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f4134e53800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788940901.517167:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788940901.517172:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068586496:0@lo:8:kworker.0 00000100:00080000:1.0:1788940901.517224:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f410f4f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940901.517229:0:3300:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788940901.517232:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068586624:0@lo:8:kworker.0 00000004:00080000:1.0:1788940901.517280:0:14452:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788940901.517298:0:14452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14452:1875840068587136:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788940901.517327:0:14452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940901.517344:0:14452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4112bbb300 going to sleep for 11 seconds 00000004:00080000:1.0:1788940901.517360:0:14451:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788940901.517469:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068587008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940901.517508:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940901.517532:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940901.517538:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:340eef01-7b53-49af-9aa3-2abb708ce8bb:3301:1875840068586368:0@lo:400:kworker.0 00000100:00100000:2.0:1788940901.517566:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940901.517617:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068587008 00000100:00100000:2.0:1788940901.517623:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068587008 00000100:00100000:2.0:1788940901.517667:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940901.517676:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875840068587008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788940901.517704:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940901.517749:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875840068587008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940901.517755:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940901.517778:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068586368 00000100:00100000:2.0:1788940901.517783:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068586368 00000100:00100000:2.0:1788940901.517808:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788940901.517815:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:3301:x1875840068586368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940901.517848:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:3301:x1875840068586368:12345-0@lo:400:kworker.0 Request processed in 33us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940901.517854:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788940901.517902:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940901.517923:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:340eef01-7b53-49af-9aa3-2abb708ce8bb:3301:1875840068586368:0@lo:400:kworker.0 00010000:00080000:2.0:1788940901.517934:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f4002db7800 x1875840068587008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940901.517949:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068587008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940901.518346:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068587136 00000100:00100000:0.0:1788940901.518353:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068587136 00000100:00100000:0.0:1788940901.518391:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788940901.518399:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14452:x1875840068587136:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788940901.524865:0:14451:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 542828673194ns, next at 0ns, rc = 0 00002000:00080000:0.0:1788940901.531610:0:15116:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788940901.531631:0:15116:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788940901.531639:0:15116:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1788940901.556008:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.556025:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004713a375/0xa1d8aa9164aa3e38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.556049:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.556055:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.556063:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004713a375/0xa1d8aa9164aa3e38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.556087:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004713a375/0xa1d8aa9164aa3e38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.556115:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004713a375/0xa1d8aa9164aa3e38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.556124:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004713a375/0xa1d8aa9164aa3e38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.556154:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940901.557296:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940901.557310:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004713a375/0xa1d8aa9164aa3e38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.557324:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100031800 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940901.557343:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004713a375/0xa1d8aa9164aa3e38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.557357:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004713a375/0xa1d8aa9164aa3e38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.557389:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004713a375/0xa1d8aa9164aa3e38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.557398:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004713a375/0xa1d8aa9164aa3e38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.557430:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940901.557433:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940901.557435:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940901.558813:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.558828:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aec18225/0xa1d8aa9164aa3e3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.558848:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.558853:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.558860:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aec18225/0xa1d8aa9164aa3e3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.558879:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aec18225/0xa1d8aa9164aa3e3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.558894:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aec18225/0xa1d8aa9164aa3e3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.558903:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aec18225/0xa1d8aa9164aa3e3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.558993:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788940901.560857:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.560876:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.560898:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.560904:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.560911:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.560928:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.560941:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.560951:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.564019:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940901.564041:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aec18225/0xa1d8aa9164aa3e3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.564059:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4100030c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940901.564066:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aec18225/0xa1d8aa9164aa3e3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.564081:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aec18225/0xa1d8aa9164aa3e3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.564109:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aec18225/0xa1d8aa9164aa3e3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.564136:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aec18225/0xa1d8aa9164aa3e3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.564162:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940901.564167:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.564174:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37a00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940901.564178:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.564220:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.564232:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.564241:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940901.564243:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940901.564245:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940901.568943:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788940901.568967:0:15116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.569714:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940901.570161:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.570172:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b305d307/0xa1d8aa9164aa3e4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.571536:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.571544:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.571554:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b305d307/0xa1d8aa9164aa3e4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.571577:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b305d307/0xa1d8aa9164aa3e4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.572380:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b305d307/0xa1d8aa9164aa3e4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.572392:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b305d307/0xa1d8aa9164aa3e4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.572426:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788940901.573420:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.573431:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3e54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.573448:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.573453:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.573460:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3e54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.573475:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3e54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.573500:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3e54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.573509:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3e54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.573542:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788940901.574018:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.574026:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3e5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.574037:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.574041:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.574045:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3e5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.574057:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3e5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.574066:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3e5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.574075:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3e5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.574096:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788940901.574276:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788940901.574287:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b305d307/0xa1d8aa9164aa3e4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574298:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36400 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940901.574311:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b305d307/0xa1d8aa9164aa3e4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574323:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b305d307/0xa1d8aa9164aa3e4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574346:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b305d307/0xa1d8aa9164aa3e4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574355:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b305d307/0xa1d8aa9164aa3e4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574382:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940901.574386:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3e54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574394:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37600 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940901.574398:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3e54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574407:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3e54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574417:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3e54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574426:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3e54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574450:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940901.574454:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3e5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574461:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940901.574465:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3e5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574474:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3e5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574486:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3e5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574493:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3e5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.574510:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940901.574513:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940901.574515:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940901.574649:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940901.579404:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.579420:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061fce0b8/0xa1d8aa9164aa3e62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.579444:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.579451:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.579459:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061fce0b8/0xa1d8aa9164aa3e62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.579477:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061fce0b8/0xa1d8aa9164aa3e62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.579489:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061fce0b8/0xa1d8aa9164aa3e62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.579497:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061fce0b8/0xa1d8aa9164aa3e62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.579517:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940901.579661:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940901.579672:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061fce0b8/0xa1d8aa9164aa3e62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.579684:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37000 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940901.579691:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061fce0b8/0xa1d8aa9164aa3e62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.579703:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061fce0b8/0xa1d8aa9164aa3e62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.579729:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061fce0b8/0xa1d8aa9164aa3e62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.579737:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061fce0b8/0xa1d8aa9164aa3e62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.579781:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.579784:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.579788:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940901.580142:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.580152:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5756c1a/0xa1d8aa9164aa3e69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.580164:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.580178:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.580236:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5756c1a/0xa1d8aa9164aa3e69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.580251:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5756c1a/0xa1d8aa9164aa3e69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.580261:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5756c1a/0xa1d8aa9164aa3e69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.580271:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5756c1a/0xa1d8aa9164aa3e69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.580292:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940901.580459:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940901.580469:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5756c1a/0xa1d8aa9164aa3e69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.580480:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37200 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940901.580485:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5756c1a/0xa1d8aa9164aa3e69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.580495:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5756c1a/0xa1d8aa9164aa3e69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.580516:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5756c1a/0xa1d8aa9164aa3e69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.580525:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5756c1a/0xa1d8aa9164aa3e69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.580556:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940901.580558:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940901.580561:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940901.580764:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.580771:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a31a6b75/0xa1d8aa9164aa3e70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.580781:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.580783:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.580788:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a31a6b75/0xa1d8aa9164aa3e70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.580799:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a31a6b75/0xa1d8aa9164aa3e70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.580808:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a31a6b75/0xa1d8aa9164aa3e70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.580823:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a31a6b75/0xa1d8aa9164aa3e70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.580853:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940901.581089:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940901.581094:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a31a6b75/0xa1d8aa9164aa3e70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.581101:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37800 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940901.581103:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a31a6b75/0xa1d8aa9164aa3e70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.581109:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a31a6b75/0xa1d8aa9164aa3e70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.581118:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a31a6b75/0xa1d8aa9164aa3e70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.581123:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a31a6b75/0xa1d8aa9164aa3e70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.581134:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940901.581135:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940901.581136:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940901.581407:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.581413:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.581423:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.581426:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.581430:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.581440:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.581448:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.581456:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.581472:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940901.581481:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940901.581485:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.581500:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37a00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940901.581504:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.581513:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.581525:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.581532:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.581546:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940901.581548:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940901.581550:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788940901.590956:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788940901.596101:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.596119:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3e7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.596144:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.596151:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.596159:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3e7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.596179:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3e7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.596244:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3e7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.596254:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3e7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.596277:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940901.596391:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940901.596402:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3e7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.596414:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36800 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940901.596422:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3e7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.596434:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3e7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.596458:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3e7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.596466:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8e338b9/0xa1d8aa9164aa3e7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.596489:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.596492:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.596495:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940901.597147:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.597158:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da9b3cc4/0xa1d8aa9164aa3e85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.597172:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.597176:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.597181:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da9b3cc4/0xa1d8aa9164aa3e85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.598025:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da9b3cc4/0xa1d8aa9164aa3e85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.598041:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da9b3cc4/0xa1d8aa9164aa3e85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.598050:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da9b3cc4/0xa1d8aa9164aa3e85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.598093:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940901.598179:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940901.598223:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da9b3cc4/0xa1d8aa9164aa3e85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.598234:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940901.598240:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da9b3cc4/0xa1d8aa9164aa3e85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.598265:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da9b3cc4/0xa1d8aa9164aa3e85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.598292:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da9b3cc4/0xa1d8aa9164aa3e85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.598300:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da9b3cc4/0xa1d8aa9164aa3e85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.598326:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940901.598328:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940901.598330:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940901.600283:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.600302:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.600324:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.600330:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.600337:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.600354:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.600367:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.600376:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.600410:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940901.600650:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940901.600660:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.600680:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37a00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940901.600685:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.600696:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.600716:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.600723:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041660e40/0xa1d8aa9164aa3e8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.600757:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.600759:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.600761:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788940901.603758:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.603774:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef92be9/0xa1d8aa9164aa3e93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.603796:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.603808:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.603816:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef92be9/0xa1d8aa9164aa3e93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.603835:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ef92be9/0xa1d8aa9164aa3e93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.603848:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef92be9/0xa1d8aa9164aa3e93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.603856:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ef92be9/0xa1d8aa9164aa3e93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.603886:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940901.606609:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940901.606631:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ef92be9/0xa1d8aa9164aa3e93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.606649:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940901.606656:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef92be9/0xa1d8aa9164aa3e93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.606671:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef92be9/0xa1d8aa9164aa3e93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.606703:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ef92be9/0xa1d8aa9164aa3e93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.606728:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef92be9/0xa1d8aa9164aa3e93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940901.606750:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.606763:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa3e9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.606767:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940901.606771:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940901.606775:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940901.606780:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.606788:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.606796:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa3e9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.606812:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa3e9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.606823:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa3e9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.606840:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa3e9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.606917:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788940901.607576:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.608709:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3ea1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.608734:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.608739:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.608745:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3ea1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.608760:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3ea1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.608773:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3ea1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.608782:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3ea1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.610091:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940901.610109:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa3e9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.610126:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36000 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940901.610131:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa3e9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.610144:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa3e9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.610171:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa3e9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.610179:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa3e9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.610250:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940901.610254:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3ea1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.610271:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36600 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940901.610275:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3ea1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.610284:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3ea1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.610295:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3ea1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.610304:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940901.610306:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940901.610308:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940901.611382:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788940901.611400:0:15116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5877670/0xa1d8aa9164aa3ea1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940901.612519:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.612531:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3ea8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.612549:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.612554:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.612562:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3ea8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.612578:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3ea8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.612715:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3ea8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.612724:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3ea8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.613309:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788940901.613907:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788940901.613917:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3eaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.613931:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=542s v=(0 0) 00010000:00010000:0.0:1788940901.613934:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940901.613945:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3eaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.613958:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3eaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.613969:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3eaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.613977:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3eaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.618118:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940901.618144:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3ea8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.618164:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940901.618170:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3ea8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.618210:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3ea8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.618268:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3ea8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.618277:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcb96566/0xa1d8aa9164aa3ea8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.618736:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940901.618744:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3eaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.618753:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37600 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940901.618757:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3eaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.618766:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3eaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.618779:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3eaf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.618790:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.618792:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.618796:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940901.619834:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940901.620064:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788940901.620077:0:15116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071ea6d50/0xa1d8aa9164aa3eaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.625279:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940901.626089:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940901.626107:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b669cbf/0xa1d8aa9164aa3eb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.626134:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1788940901.626148:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940901.626155:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b669cbf/0xa1d8aa9164aa3eb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.626174:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b669cbf/0xa1d8aa9164aa3eb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.627508:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b669cbf/0xa1d8aa9164aa3eb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.627531:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b669cbf/0xa1d8aa9164aa3eb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.627565:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940901.627754:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940901.627763:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b669cbf/0xa1d8aa9164aa3eb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.627773:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4400 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940901.627779:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b669cbf/0xa1d8aa9164aa3eb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.627791:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b669cbf/0xa1d8aa9164aa3eb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.627837:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b669cbf/0xa1d8aa9164aa3eb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.627845:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b669cbf/0xa1d8aa9164aa3eb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940901.627872:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940901.627875:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940901.627877:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940901.629402:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940901.629416:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa3ebd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.629436:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1788940901.629441:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940901.629449:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa3ebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.629465:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa3ebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.629476:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa3ebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.629491:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa3ebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.629521:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940901.629618:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940901.629628:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa3ebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.629651:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4600 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940901.629657:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa3ebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.629668:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa3ebd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.629687:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa3ebd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.629695:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd1dd523/0xa1d8aa9164aa3ebd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.629716:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.629718:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.629719:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940901.633983:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940901.634008:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3ec4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.634032:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1788940901.634038:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940901.634046:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3ec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.634067:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3ec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.634080:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3ec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.634089:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3ec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.634113:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788940901.634747:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940901.634755:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3ecb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.634771:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1788940901.634775:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940901.634779:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3ecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.634789:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3ecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.634797:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3ecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.634805:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3ecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.634830:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788940901.634992:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940901.635004:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3ec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635016:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940901.635022:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3ec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635034:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3ec4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635067:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3ec4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635075:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec471b56/0xa1d8aa9164aa3ec4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635103:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940901.635107:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3ecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635115:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940901.635118:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3ecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635125:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3ecb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635136:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3ecb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635145:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddfd7ef6/0xa1d8aa9164aa3ecb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635161:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.635163:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.635171:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940901.635345:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940901.635352:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d525e729/0xa1d8aa9164aa3ed2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.635361:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1788940901.635365:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940901.635369:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d525e729/0xa1d8aa9164aa3ed2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.635378:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d525e729/0xa1d8aa9164aa3ed2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.635401:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d525e729/0xa1d8aa9164aa3ed2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.635409:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d525e729/0xa1d8aa9164aa3ed2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.635434:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940901.635455:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940901.635461:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d525e729/0xa1d8aa9164aa3ed2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635470:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4a00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940901.635474:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d525e729/0xa1d8aa9164aa3ed2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635482:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d525e729/0xa1d8aa9164aa3ed2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635496:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d525e729/0xa1d8aa9164aa3ed2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635504:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d525e729/0xa1d8aa9164aa3ed2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.635521:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.635523:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.635525:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940901.635883:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940901.635890:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf29ce0a/0xa1d8aa9164aa3ed9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.635900:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1788940901.635904:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940901.635908:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf29ce0a/0xa1d8aa9164aa3ed9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.635918:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf29ce0a/0xa1d8aa9164aa3ed9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.635927:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf29ce0a/0xa1d8aa9164aa3ed9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.635935:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf29ce0a/0xa1d8aa9164aa3ed9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.635968:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940901.636019:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940901.636026:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf29ce0a/0xa1d8aa9164aa3ed9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.636035:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940901.636039:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf29ce0a/0xa1d8aa9164aa3ed9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.636062:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf29ce0a/0xa1d8aa9164aa3ed9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.636079:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf29ce0a/0xa1d8aa9164aa3ed9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.636089:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf29ce0a/0xa1d8aa9164aa3ed9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940901.636108:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.636110:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.636113:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940901.636478:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940901.636485:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e29701d5/0xa1d8aa9164aa3ee0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.636495:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1788940901.636498:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940901.636502:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e29701d5/0xa1d8aa9164aa3ee0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.636512:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e29701d5/0xa1d8aa9164aa3ee0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.636519:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e29701d5/0xa1d8aa9164aa3ee0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.636527:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e29701d5/0xa1d8aa9164aa3ee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.636547:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788940901.636992:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940901.636998:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3440424/0xa1d8aa9164aa3ee7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.637008:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1788940901.637017:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940901.637022:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3440424/0xa1d8aa9164aa3ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.637032:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3440424/0xa1d8aa9164aa3ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.637041:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3440424/0xa1d8aa9164aa3ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.637047:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3440424/0xa1d8aa9164aa3ee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.637056:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788940901.637386:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788940901.637395:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e29701d5/0xa1d8aa9164aa3ee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.637405:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d4800 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940901.637410:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e29701d5/0xa1d8aa9164aa3ee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.637420:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e29701d5/0xa1d8aa9164aa3ee0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.637452:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e29701d5/0xa1d8aa9164aa3ee0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.637460:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e29701d5/0xa1d8aa9164aa3ee0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.637481:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940901.637485:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3440424/0xa1d8aa9164aa3ee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.637492:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5400 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940901.637495:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3440424/0xa1d8aa9164aa3ee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.637503:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3440424/0xa1d8aa9164aa3ee7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.637514:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3440424/0xa1d8aa9164aa3ee7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.637523:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3440424/0xa1d8aa9164aa3ee7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.637535:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940901.637536:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940901.637543:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940901.637821:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788940901.644104:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788940901.644122:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002958091c/0xa1d8aa9164aa3eee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.644145:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=542s v=(0 0) 00010000:00010000:1.0:1788940901.644151:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940901.644159:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002958091c/0xa1d8aa9164aa3eee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.644175:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002958091c/0xa1d8aa9164aa3eee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.645390:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002958091c/0xa1d8aa9164aa3eee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.645433:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002958091c/0xa1d8aa9164aa3eee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940901.645508:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788940901.645860:0:15116:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1788940901.645991:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14452:x1875840068587136:12345-0@lo:5:osp-pre-0-0.0 Request processed in 127588us (128658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940901.646001:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788940901.646052:0:14452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14452:1875840068587136:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788940901.646076:0:14452:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788940901.646145:0:14452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a697480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14452:1875840068587264:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788940901.646226:0:14452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940901.646285:0:14452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41080e26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940901.647178:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068587264 00000100:00100000:2.0:1788940901.647226:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068587264 00000100:00100000:2.0:1788940901.647291:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940901.647303:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14452:x1875840068587264:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788940901.647370:0:15115:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1788940901.647710:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940901.647722:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002958091c/0xa1d8aa9164aa3eee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.647737:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f41073d5a00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940901.647743:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002958091c/0xa1d8aa9164aa3eee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.647755:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002958091c/0xa1d8aa9164aa3eee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.647781:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002958091c/0xa1d8aa9164aa3eee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.647790:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002958091c/0xa1d8aa9164aa3eee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940901.647820:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940901.647822:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940901.647823:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940901.655476:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a696300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14452:x1875840068587264:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8162us (9239us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788940901.655492:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940901.655699:0:14452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a697480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14452:1875840068587264:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788940901.655724:0:14452:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1788940901.897051:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940902.923809:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788940903.077876:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788940903.077900:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1788940903.952402:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940904.974333:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940905.992665:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940907.025742:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940907.032742:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068587392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940907.032858:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940907.032960:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068587392 00000100:00100000:1.0:1788940907.032970:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068587392 00000100:00100000:1.0:1788940907.033051:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940907.033063:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068587392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940907.033106:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940907.033169:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068587392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940907.033178:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788940907.033252:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788940907.033279:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068587392:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788940907.033511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940907.033584:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788940907.033589:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f410f4f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940907.033595:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 542 00000100:00080000:2.0:1788940907.033600:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788940907.033611:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f410f4f3800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:2.0:1788940907.033638:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f413a038380 x1875840068587648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940907.033809:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:340eef01-7b53-49af-9aa3-2abb708ce8bb:3303:1875840068587520:0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.033922:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940907.033960:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940907.033966:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068587776:0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.034003:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940907.034036:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068587648:0@lo:8:kworker.0 00000100:00100000:1.0:1788940907.034065:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940907.034091:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068587904:0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.034117:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940907.034158:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068587776 00000100:00100000:1.0:1788940907.034164:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068587776 00000100:00100000:1.0:1788940907.034228:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068587904 00000100:00100000:1.0:1788940907.034232:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068587904 00000100:00100000:1.0:1788940907.034254:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788940907.034262:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068587776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.034308:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068587776:12345-0@lo:400:kworker.0 Request processed in 46us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940907.034315:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788940907.034329:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940907.034334:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068587904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.034361:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068587904:12345-0@lo:400:kworker.0 Request processed in 27us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940907.034366:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940907.034384:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068587648 00000100:00100000:1.0:1788940907.034387:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068587648 00000100:00100000:1.0:1788940907.034405:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788940907.034410:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3300:x1875840068587648:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788940907.034428:0:15116:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788940907.034620:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068587520 00000100:00100000:2.0:1788940907.034625:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068587520 00000100:00100000:2.0:1788940907.034659:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788940907.034665:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:3303:x1875840068587520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940907.034717:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:3303:x1875840068587520:12345-0@lo:400:kworker.0 Request processed in 52us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940907.034723:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788940907.035556:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940907.035565:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788940907.037365:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f413a03aa00 x1875840068587776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940907.037390:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068587776:0@lo:400:kworker.0 00000100:00100000:0.0:1788940907.037405:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:340eef01-7b53-49af-9aa3-2abb708ce8bb:3303:1875840068587520:0@lo:400:kworker.0 00010000:00080000:0.0:1788940907.041299:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f413a03b480 x1875840068587904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940907.041325:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068587904:0@lo:400:kworker.0 00000100:00100000:1.0:1788940907.067295:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3300:x1875840068587648:12345-0@lo:8:kworker.0 Request processed in 32866us (33212us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788940907.067337:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788940907.067451:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f410f4f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788940907.067458:0:3300:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788940907.067464:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068587648:0@lo:8:kworker.0 00010000:00010000:0.0:1788940908.049513:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788940908.164630:0:15832:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788940908.164637:0:15832:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788940908.164772:0:15832:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f4112972000 00000020:01000004:1.0:1788940908.164793:0:15832:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788940908.164811:0:15832:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788940908.164832:0:15832:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f413f41cd40) 00000020:00000080:1.0:1788940908.164852:0:15832:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788940908.222624:0:15832:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788940908.222984:0:15832:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788940908.224913:0:15832:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788940908.225939:0:15832:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788940908.226714:0:15832:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788940908.227926:0:15832:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 101: rc = 0 00100000:10000000:2.0:1788940908.228019:0:15832:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 101: rc = 0 00100000:10000000:2.0:1788940908.228849:0:15832:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 101: rc = 0 00100000:10000000:2.0:1788940908.229970:0:15832:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 792: rc = 0 00100000:10000000:2.0:1788940908.230678:0:15832:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 792: rc = 0 00100000:10000000:2.0:1788940908.230945:0:15832:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 792: rc = 0 00100000:10000000:2.0:1788940908.231881:0:15832:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 792: rc = 0 00100000:10000000:2.0:1788940908.232798:0:15832:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 792: rc = 0 00100000:10000000:2.0:1788940908.233083:0:15832:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 792: rc = 0 00000020:00000080:2.0:1788940908.234104:0:15832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788940908.234122:0:15832:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788940908.234151:0:15832:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa1d8aa9164aa3efc 00000020:01000004:2.0:1788940908.234163:0:15832:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788940908.234226:0:15832:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.117@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788940908.234241:0:15832:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.117@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788940908.234249:0:15832:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788940908.234280:0:15832:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788940908.234285:0:15832:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.117@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788940908.255864:0:15832:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.117@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788940908.255922:0:15832:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.117@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788940908.255928:0:15832:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788940908.255935:0:15832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788940908.255937:0:15832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940908.255938:0:15832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940908.255939:0:15832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940908.255941:0:15832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940908.255943:0:15832:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940908.255944:0:15832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940908.255946:0:15832:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940908.255950:0:15832:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788940908.255953:0:15832:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788940908.255954:0:15832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788940908.255955:0:15832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788940908.255956:0:15832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788940908.255957:0:15832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788940908.255958:0:15832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788940908.255959:0:15832:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788940908.255960:0:15832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788940908.255961:0:15832:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788940908.256015:0:15832:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788940908.256044:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a696d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588032:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788940908.256808:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940908.257067:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f413a5b8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788940908.257574:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068588032 00000100:00100000:2.0:1788940908.257589:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068588032 00000100:00100000:2.0:1788940908.257706:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788940908.257719:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15832:x1875840068588032:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788940908.257785:0:14423:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788940908.257789:0:14423:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788940908.257794:0:14423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788940908.277969:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15832:x1875840068588032:12345-0@lo:253:mount.lustre.0 Request processed in 20238us (21150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.277990:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788940908.278119:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a696d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588032:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788940908.278155:0:15832:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788940908.278159:0:15832:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940908.278161:0:15832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940908.278163:0:15832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940908.278164:0:15832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940908.278166:0:15832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940908.278167:0:15832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940908.278170:0:15832:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940908.278172:0:15832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940908.278174:0:15832:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788940908.278243:0:15832:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f4112972000 from lustre-OST0001 10000000:01000000:0.0:1788940908.278282:0:15832:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788940908.278285:0:15832:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788940908.278675:0:15832:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f41182899c0 local copy 00010000:00010000:0.0:1788940908.278689:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d4200/0xa1d8aa9164aa3ca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3cb0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940908.279037:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788940908.279116:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940908.279565:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108e9c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940908.279701:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068588160 00000100:00100000:3.0:1788940908.279710:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068588160 00000100:00100000:3.0:1788940908.279970:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788940908.279984:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15832:x1875840068588160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940908.280313:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15832:x1875840068588160:12345-0@lo:501:mount.lustre.0 Request processed in 331us (1195us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788940908.280322:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788940908.280418:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588160:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788940908.280441:0:15832:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.117@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788940908.280614:0:15832:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.117@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788940908.280625:0:15832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d4200/0xa1d8aa9164aa3ca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3cb0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.280638:0:15832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f41073d4200/0xa1d8aa9164aa3ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3cb0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940908.280679:0:15832:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f4112972000 10000000:01000000:0.0:1788940908.280686:0:15832:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788940908.280693:0:15832:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788940908.280696:0:15832:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788940908.280701:0:15832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788940908.280705:0:15832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788940908.280742:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa3f03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.280751:0:15832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa3f03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.280762:0:15832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa3f03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940908.280784:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588288:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788940908.280820:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940908.281809:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108e9c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940908.281895:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068588288 00000100:00100000:1.0:1788940908.281904:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068588288 00000100:00100000:1.0:1788940908.281951:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788940908.281959:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4116a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:15832:x1875840068588288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940908.281973:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940908.281993:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f41073d4400/0xa1d8aa9164aa3f0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3f03 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.282024:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f41073d4400/0xa1d8aa9164aa3f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3f03 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.282036:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f41073d4400/0xa1d8aa9164aa3f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3f03 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.282047:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4400, rc 0) 00000100:00100000:1.0:1788940908.282407:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4116a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:15832:x1875840068588288:12345-0@lo:101:mount.lustre.0 Request processed in 446us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.282415:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788940908.282797:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588288:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788940908.282821:0:15832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa3f03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3f0a expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.282833:0:15832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa3f03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3f0a expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940908.284022:0:15832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788940908.285803:0:15832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940908.286117:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788940908.286898:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788940908.286937:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788940908.286993:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788940908.287022:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788940908.287049:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788940908.287114:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788940908.287122:0:15832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788940908.287721:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940908.287812:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940908.287947:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41080e2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788940908.288076:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068588416 00000100:00100000:3.0:1788940908.288086:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068588416 00000100:00100000:3.0:1788940908.288681:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788940908.288696:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:15832:x1875840068588416:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940908.289282:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:15832:x1875840068588416:12345-0@lo:501:mount.lustre.0 Request processed in 589us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940908.289450:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788940908.289654:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940908.289723:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588544:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940908.290524:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940908.296563:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068588544 00000100:00100000:1.0:1788940908.296588:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068588544 00000100:00100000:1.0:1788940908.296681:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788940908.296694:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:15832:x1875840068588544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940908.302827:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:15832:x1875840068588544:12345-0@lo:503:mount.lustre.0 Request processed in 6120us (12294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.302846:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788940908.303806:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41071a10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940908.303854:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588544:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788940908.317938:0:15832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788940908.318138:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940908.318286:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940908.318927:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108e9c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940908.322654:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068588672 00000100:00100000:3.0:1788940908.322677:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068588672 00000100:00100000:3.0:1788940908.322829:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788940908.322843:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:15832:x1875840068588672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940908.323360:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:15832:x1875840068588672:12345-0@lo:502:mount.lustre.0 Request processed in 518us (5073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940908.323371:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788940908.323779:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788940908.324101:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788940908.324179:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788940908.324622:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788940908.324683:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788940908.324719:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788940908.324751:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788940908.324814:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788940908.324852:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788940908.324899:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788940908.324958:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940908.325037:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940908.326033:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108e9c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788940908.326476:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068588800 00000100:00100000:1.0:1788940908.326761:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068588800 00000100:00100000:1.0:1788940908.326831:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788940908.326842:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:15832:x1875840068588800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788940908.328038:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:15832:x1875840068588800:12345-0@lo:502:mount.lustre.0 Request processed in 1193us (2995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.328064:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788940908.328775:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788940908.329013:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788940908.329034:0:15832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788940908.333109:0:15833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788940908.333610:0:15833:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788940908.333624:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788940908.333628:0:15833:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788940908.333639:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788940908.333662:0:15833:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f413f41b380) 00000020:00000080:1.0:1788940908.333703:0:15833:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788940908.333711:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788940908.333859:0:15833:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f4112972000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788940908.333870:0:15833:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788940908.333883:0:15833:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa1d8aa9164aa3f18 00010000:00010000:1.0:1788940908.342828:0:15833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788940908.344935:0:15833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788940908.356851:0:15833:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788940908.362105:0:15833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788940908.362142:0:15833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940908.362151:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940908.362154:0:15833:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788940908.362158:0:15833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940908.362164:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940908.362165:0:15833:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788940908.362168:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788940908.362170:0:15833:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788940908.362173:0:15833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940908.362175:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940908.362176:0:15833:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788940908.362210:0:15833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788940908.362214:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940908.362215:0:15833:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788940908.362219:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788940908.362953:0:15833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788940908.362960:0:15833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788940908.362962:0:15833:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788940908.362966:0:15833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788940908.364731:0:15832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788940908.364800:0:15832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788940908.364835:0:15832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa3f03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3f0a expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.364854:0:15832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4113b36800/0xa1d8aa9164aa3f03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3f0a expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940908.364867:0:15832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f4112972000 from 1 10000000:01000000:2.0:1788940908.364897:0:15832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940908.364954:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.364964:0:15832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.364979:0:15832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940908.365017:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788940908.365119:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940908.365243:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41071a1180 going to sleep for 11 seconds 00000100:00100000:1.0:1788940908.365373:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068588928 00000100:00100000:1.0:1788940908.365393:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068588928 00000100:00100000:1.0:1788940908.365451:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788940908.365462:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:15832:x1875840068588928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940908.365641:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940908.365661:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f41073d4600/0xa1d8aa9164aa3f26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3f1f expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.365692:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f41073d4600/0xa1d8aa9164aa3f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3f1f expref: 18 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.365703:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f41073d4600/0xa1d8aa9164aa3f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3f1f expref: 18 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.365732:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4600, rc 0) 00000100:00100000:1.0:1788940908.365784:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f587050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:15832:x1875840068588928:12345-0@lo:101:mount.lustre.0 Request processed in 324us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.365792:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788940908.366748:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068588928:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940908.366777:0:15832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3f26 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.366789:0:15832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3f26 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788940908.371918:0:15832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788940908.376395:0:15832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788940908.378577:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788940908.378644:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788940908.378706:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788940908.378713:0:15832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788940908.378865:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940908.378961:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940908.379022:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41071a1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788940908.380000:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068589056 00000100:00100000:3.0:1788940908.380027:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068589056 00000100:00100000:3.0:1788940908.380094:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788940908.380107:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f35dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:15832:x1875840068589056:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788940908.381080:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f35dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:15832:x1875840068589056:12345-0@lo:501:mount.lustre.0 Request processed in 967us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940908.381094:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788940908.381651:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589056:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940908.381742:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940908.381808:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940908.381866:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41071a1180 going to sleep for 11 seconds 00000100:00100000:1.0:1788940908.382075:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068589184 00000100:00100000:1.0:1788940908.382085:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068589184 00000100:00100000:1.0:1788940908.382149:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788940908.382159:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f35f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:15832:x1875840068589184:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788940908.382461:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f35f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:15832:x1875840068589184:12345-0@lo:503:mount.lustre.0 Request processed in 302us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.382469:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788940908.382745:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589184:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788940908.384940:0:15832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788940908.385055:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940908.385158:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940908.385225:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41071a1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788940908.385410:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068589312 00000100:00100000:3.0:1788940908.385420:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068589312 00000100:00100000:3.0:1788940908.385490:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788940908.385501:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f35f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:15832:x1875840068589312:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940908.385745:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f35f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:15832:x1875840068589312:12345-0@lo:502:mount.lustre.0 Request processed in 245us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940908.385754:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788940908.387586:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940908.387954:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788940908.388025:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788940908.388070:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788940908.388104:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788940908.392104:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788940908.394042:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788940908.394090:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788940908.394137:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788940908.394234:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940908.394368:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940908.394422:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41071a1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788940908.394530:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068589440 00000100:00100000:3.0:1788940908.394541:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068589440 00000100:00100000:3.0:1788940908.394611:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788940908.394623:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4140d45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:15832:x1875840068589440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788940908.394888:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4140d45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:15832:x1875840068589440:12345-0@lo:502:mount.lustre.0 Request processed in 267us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940908.394897:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788940908.396744:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940908.396991:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788940908.397011:0:15832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788940908.400572:0:15837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940908.400590:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940908.400594:0:15837:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788940908.400611:0:15837:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f4112972000 00000020:00000080:2.0:1788940908.400614:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788940908.400624:0:15837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940908.400627:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940908.400628:0:15837:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788940908.400631:0:15837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940908.400634:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940908.400635:0:15837:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788940908.400639:0:15837:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f4112972000 00000020:00000080:2.0:1788940908.400641:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788940908.400757:0:15837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940908.400761:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940908.400763:0:15837:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788940908.400766:0:15837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788940908.400768:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940908.400769:0:15837:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788940908.400773:0:15837:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f4112972000 00000020:00000080:2.0:1788940908.400775:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788940908.402386:0:15837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788940908.402400:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788940908.402402:0:15837:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788940908.402407:0:15837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788940908.408391:0:15832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788940908.408462:0:15832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940908.408498:0:15832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3f26 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.408516:0:15832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3f26 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940908.408597:0:15832:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788940908.408601:0:15832:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f4112972000 10000000:01000000:1.0:1788940908.408605:0:15832:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f4112972000 10000000:01000000:1.0:1788940908.408610:0:15832:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788940908.408617:0:15832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f4112972000 from 1 10000000:01000000:1.0:1788940908.408621:0:15832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788940908.408672:0:15832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d5e00/0xa1d8aa9164aa3f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.408696:0:15832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f41073d5e00/0xa1d8aa9164aa3f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.408710:0:15832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f41073d5e00/0xa1d8aa9164aa3f2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940908.408744:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788940908.408845:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940908.419564:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410726b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940908.419927:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068589568 00000100:00100000:2.0:1788940908.419940:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068589568 00000100:00100000:2.0:1788940908.420060:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788940908.420073:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4140d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:15832:x1875840068589568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788940908.420097:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940908.420139:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f412bfc7e00/0xa1d8aa9164aa3f34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3f2d expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.420180:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f412bfc7e00/0xa1d8aa9164aa3f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3f2d expref: 19 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.422926:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f412bfc7e00/0xa1d8aa9164aa3f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3f2d expref: 19 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940908.422939:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7e00, rc 0) 00000100:00100000:2.0:1788940908.423063:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4140d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:15832:x1875840068589568:12345-0@lo:101:mount.lustre.0 Request processed in 2992us (14216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940908.423073:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788940908.423267:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788940908.423301:0:15832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f41073d5e00/0xa1d8aa9164aa3f2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3f34 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940908.423315:0:15832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f41073d5e00/0xa1d8aa9164aa3f2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3f34 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940908.424253:0:15832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788940908.425042:0:15832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788940908.425399:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788940908.425447:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788940908.425482:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788940908.425531:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788940908.425570:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788940908.425640:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788940908.425679:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788940908.425716:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788940908.425796:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788940908.425838:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788940908.425886:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788940908.425940:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788940908.425976:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788940908.426012:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788940908.426059:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788940908.426093:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788940908.426122:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788940908.433754:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788940908.433807:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788940908.433841:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788940908.433888:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788940908.433944:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788940908.433972:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788940908.434014:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788940908.434045:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788940908.434074:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788940908.436615:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788940908.436751:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788940908.436779:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788940908.436848:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788940908.436876:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788940908.436902:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788940908.436929:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788940908.436994:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788940908.437025:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788940908.437063:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788940908.437091:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788940908.440816:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788940908.440844:0:15832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788940908.441002:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788940908.441103:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940908.441177:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410726b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940908.442274:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068589696 00000100:00100000:2.0:1788940908.442292:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068589696 00000100:00100000:2.0:1788940908.442364:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788940908.442377:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4140d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:15832:x1875840068589696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940908.442782:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4140d45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:15832:x1875840068589696:12345-0@lo:501:mount.lustre.0 Request processed in 406us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940908.442792:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788940908.442862:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788940908.442920:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940908.442972:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940908.443000:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068589824 00000100:00100000:2.0:1788940908.443005:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068589824 00000100:00100000:2.0:1788940908.443031:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788940908.443038:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4140d47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:15832:x1875840068589824:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788940908.443258:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4140d47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:15832:x1875840068589824:12345-0@lo:503:mount.lustre.0 Request processed in 219us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940908.443265:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788940908.443306:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41071a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940908.443319:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589824:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788940908.443949:0:15832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788940908.444040:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940908.444097:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940908.444150:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068589952 00000100:00100000:2.0:1788940908.444155:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068589952 00000100:00100000:2.0:1788940908.444216:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788940908.444224:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4140d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:15832:x1875840068589952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940908.444440:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4140d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:15832:x1875840068589952:12345-0@lo:502:mount.lustre.0 Request processed in 215us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940908.444447:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788940908.444485:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41071a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788940908.444503:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068589952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788940908.444760:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788940908.444810:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788940908.444847:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788940908.444899:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788940908.444940:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788940908.444993:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788940908.445032:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788940908.445072:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788940908.456443:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788940908.458462:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788940908.458516:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788940908.458634:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788940908.458673:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788940908.458708:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788940908.458756:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788940908.458794:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788940908.458859:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788940908.458911:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788940908.458949:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788940908.458987:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788940908.459037:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788940908.459067:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788940908.459096:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788940908.459159:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788940908.459231:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788940908.459266:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788940908.459314:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788940908.459351:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788940908.459387:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788940908.459437:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788940908.459476:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788940908.459511:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788940908.459566:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788940908.459618:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788940908.459652:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788940908.459718:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788940908.459757:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788940908.459789:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788940908.459838:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788940908.459873:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788940908.459943:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068590080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788940908.460055:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940908.460121:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108e9c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788940908.460472:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068590080 00000100:00100000:2.0:1788940908.460483:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068590080 00000100:00100000:2.0:1788940908.460555:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788940908.460567:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4140d45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:15832:x1875840068590080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788940908.460951:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4140d45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:15832:x1875840068590080:12345-0@lo:502:mount.lustre.0 Request processed in 386us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940908.460968:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788940908.466519:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068590080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788940908.466728:0:15832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788940908.466748:0:15832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788940908.476151:0:15841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788940908.476179:0:15841:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f4141523380) 00000020:00000080:2.0:1788940908.476235:0:15841:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788940908.476360:0:15841:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f4112972000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788940908.476365:0:15841:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f4112972000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788940908.476368:0:15841:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f4112972000 3 00010000:00080000:2.0:1788940908.476409:0:15841:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f4002fa6000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.117@tcp at head 00010000:00010000:2.0:1788940908.478473:0:15841:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788940908.478763:0:15841:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788940908.478813:0:15841:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788940908.478829:0:15841:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa1d8aa9164aa3f42 00000100:00080000:2.0:1788940908.478846:0:15841:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788940908.478860:0:15841:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f4002fa6000 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:2.0:1788940908.478920:0:15841:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f413a03a300 x1875840068590208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940908.478970:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1875840068590208:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788940908.479066:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788940908.483905:0:15841:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788940908.492637:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940908.492648:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788940908.492652:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f410f4f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940908.492664:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 548 00000100:00080000:2.0:1788940908.492671:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788940908.492688:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f410f4f3800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:2.0:1788940908.492718:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f413a038e00 x1875840068590464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940908.492839:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068590208 00000100:00100000:2.0:1788940908.492849:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068590208 00000100:00100000:2.0:1788940908.492905:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940908.492915:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a03bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3300:x1875840068590208:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788940908.492954:0:14429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:2.0:1788940908.493039:0:14429:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa1d8aa9164aa3f49 00000004:00100000:2.0:1788940908.493064:0:14429:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788940908.493599:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068590336:0@lo:400:kworker.0 00000100:00100000:0.0:1788940908.493705:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940908.493815:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068590336 00000100:00100000:1.0:1788940908.493821:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068590336 00000100:00100000:1.0:1788940908.493878:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788940908.493889:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068590336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940908.493952:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068590336:12345-0@lo:400:kworker.0 Request processed in 65us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.493960:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940908.494135:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068590336:0@lo:400:kworker.0 00000100:00080000:2.0:1788940908.494403:0:14429:0:(import.c:65:import_set_state_nolock()) ffff8f4112973800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940908.494464:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a03bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875840068590208:12345-0@lo:38:llog_process_th.0 Request processed in 1548us (15397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940908.494526:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940908.494666:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068590592:0@lo:400:kworker.0 00000100:00100000:2.0:1788940908.494702:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940908.494771:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940908.494780:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a03b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068590720:0@lo:400:kworker.0 00000100:00100000:2.0:1788940908.494812:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788940908.506377:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f413a03a300 x1875840068590208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788940918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940908.506399:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788940908.506415:0:3300:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788940908.506426:0:3300:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788940908.506435:0:3300:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788940908.506458:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f4002fa6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788940908.506517:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3300:1875840068590208:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788940908.506565:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068590464:0@lo:8:kworker.0 00000100:00100000:3.0:1788940908.506659:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940908.506844:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068590464 00000100:00100000:1.0:1788940908.506854:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068590464 00000100:00100000:1.0:1788940908.506916:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940908.506927:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3300:x1875840068590464:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788940908.507010:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a697b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3300:x1875840068590464:12345-0@lo:8:kworker.0 Request processed in 83us (350us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788940908.507018:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940908.507718:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788940908.507727:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f410f4f3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940908.507732:0:3300:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788940908.507736:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068590464:0@lo:8:kworker.0 00000040:00080000:3.0:1788940908.509183:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788940908.509587:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068590592 00000100:00100000:0.0:1788940908.509600:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068590592 00000100:00100000:0.0:1788940908.509656:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068590720 00000100:00100000:0.0:1788940908.509660:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068590720 00000100:00100000:0.0:1788940908.509683:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788940908.509694:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068590592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940908.509821:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068590592:12345-0@lo:400:kworker.0 Request processed in 127us (15117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940908.509830:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788940908.509849:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940908.509855:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a03aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068590720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940908.509884:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a03aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068590720:12345-0@lo:400:kworker.0 Request processed in 30us (15071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940908.509889:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000040:00080000:0.0:1788940908.510259:0:15841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:3.0:1788940908.510822:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f413a03b480 x1875840068590720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940908.510843:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a03b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068590720:0@lo:400:kworker.0 00010000:00080000:3.0:1788940908.510859:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f413a038380 x1875840068590592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940908.510868:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068590592:0@lo:400:kworker.0 00000020:01000000:0.0:1788940908.511286:0:15832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788940908.511331:0:15832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788940908.511357:0:15832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d5e00/0xa1d8aa9164aa3f2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3f34 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.511370:0:15832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f41073d5e00/0xa1d8aa9164aa3f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3f34 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788940908.511456:0:15832:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788940908.511459:0:15832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940908.511460:0:15832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940908.511462:0:15832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940908.511463:0:15832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940908.511613:0:15832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940908.511616:0:15832:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940908.511618:0:15832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940908.511620:0:15832:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940908.511624:0:15832:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788940908.511627:0:15832:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788940908.511629:0:15832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940908.511630:0:15832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940908.511631:0:15832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940908.511632:0:15832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940908.511633:0:15832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940908.511635:0:15832:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940908.511636:0:15832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940908.511637:0:15832:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788940908.511668:0:15832:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788940908.511692:0:15832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068590848:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788940908.511775:0:15832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940908.511832:0:15832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108e9cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788940908.511900:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068590848 00000100:00100000:2.0:1788940908.511908:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068590848 00000100:00100000:2.0:1788940908.511967:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788940908.511977:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4140d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:15832:x1875840068590848:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788940908.512013:0:14424:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788940908.512032:0:14424:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788940908.590074:0:14424:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788940908.590099:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788940908.590292:0:14445:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788940908.590298:0:14445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788940908.590333:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.590356:0:14445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f412bfc7000/0xa1d8aa9164aa3e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3e23 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.590366:0:14445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.590447:0:14445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f412bfc7000/0xa1d8aa9164aa3e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa3e23 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940908.590463:0:14445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f412bfc7000/0xa1d8aa9164aa3e2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3e23 expref: 19 pid: 14424 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940908.591029:0:14445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1875840068590976:0@lo:104: 00000100:00100000:0.0:1788940908.591143:0:14445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940908.591336:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068590976 00000100:00100000:3.0:1788940908.591348:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068590976 00000100:00100000:3.0:1788940908.591411:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940908.591424:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:340eef01-7b53-49af-9aa3-2abb708ce8bb+3:14445:x1875840068590976:12345-0@lo:104: 00010000:00010000:3.0:1788940908.591440:0:14414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa3e2a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.591525:0:14414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788940908.591532:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:340eef01-7b53-49af-9aa3-2abb708ce8bb+3:14445:x1875840068590976:12345-0@lo:104: Request processed in 111us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940908.591540:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788940908.591567:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940908.591575:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa3e2a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.591598:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6800 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:3.0:1788940908.591602:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa3e2a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.591610:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa3e2a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940908.591616:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa3e2a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940908.591622:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788940908.591658:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3e2a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.591665:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940908.591691:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3e2a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.591699:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6800/0xa1d8aa9164aa3e23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3e2a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.591720:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940908.591722:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940908.591724:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940908.591747:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:340eef01-7b53-49af-9aa3-2abb708ce8bb:3301:1875840068591104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940908.591779:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940908.592014:0:14445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788940908.592046:0:14445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14445:1875840068590976:0@lo:104: 00010000:00010000:0.0:1788940908.592071:0:14445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940908.595044:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068591104 00000100:00100000:3.0:1788940908.595064:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068591104 00010000:00010000:3.0:1788940908.595117:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f412bfc7000/0xa1d8aa9164aa3e2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3e23 expref: 20 pid: 14424 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940908.595220:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940908.595233:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:340eef01-7b53-49af-9aa3-2abb708ce8bb+20:3301:x1875840068591104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940908.595255:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940908.595262:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f412bfc7000/0xa1d8aa9164aa3e2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3e23 expref: 20 pid: 14424 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.595277:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f412bfc7000/0xa1d8aa9164aa3e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3e23 expref: 20 pid: 14424 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.595301:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f412bfc7000/0xa1d8aa9164aa3e2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa3e23 expref: 20 pid: 14424 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.595321:0:14415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.595331:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788940908.595355:0:14415:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005057064s 00010000:00010000:3.0:1788940908.595361:0:14415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.595368:0:14415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.595376:0:14415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.595384:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.595397:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37a00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940908.595403:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.595412:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.595431:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.595444:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940908.595898:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3301:x1875840068591104:12345-0@lo:103:ldlm_bl.0 Request processed in 665us (4114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940908.595908:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788940908.595945:0:14445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.595956:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940908.595964:0:14445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4113b37a00/0xa1d8aa9164aa3f50 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940908.596049:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a694700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:340eef01-7b53-49af-9aa3-2abb708ce8bb:3301:1875840068591104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940908.609175:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4140d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:15832:x1875840068590848:12345-0@lo:253:mount.lustre.0 Request processed in 97186us (97387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940908.609220:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788940908.609367:0:15832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:340eef01-7b53-49af-9aa3-2abb708ce8bb:15832:1875840068590848:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788940908.609389:0:15832:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788940908.609394:0:15832:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788940908.609396:0:15832:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788940908.609398:0:15832:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788940908.609399:0:15832:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788940908.609400:0:15832:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788940908.609401:0:15832:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788940908.609403:0:15832:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788940908.609406:0:15832:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788940908.609408:0:15832:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788940908.609427:0:15832:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788940908.616298:0:15832:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940908.616656:0:15832:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940908.616842:0:15832:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940908.617011:0:15832:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788940908.617171:0:15832:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788940908.617399:0:15832:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788940908.619062:0:15832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788940908.716273:0:15832:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788940908.716288:0:15832:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788940908.716339:0:15832:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788940908.716432:0:15832:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.117@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788940908.716456:0:15832:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788940908.716917:0:15832:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788940909.078681:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788940909.649519:0:14427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788940909.649529:0:14427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f4002627000 from 8 10000000:01000000:1.0:1788940909.649534:0:14427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788940909.649581:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d5c00/0xa1d8aa9164aa3f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.649594:0:14427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f41073d5c00/0xa1d8aa9164aa3f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.649606:0:14427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f41073d5c00/0xa1d8aa9164aa3f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940909.649634:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068591232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788940909.649716:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940909.649766:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410634a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940909.649791:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068591232 00000100:00100000:1.0:1788940909.649800:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068591232 00000100:00100000:1.0:1788940909.649854:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940909.649864:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:14427:x1875840068591232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940909.649878:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940909.649901:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f41073d4800/0xa1d8aa9164aa3f5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa3f57 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.649928:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f41073d4800/0xa1d8aa9164aa3f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3f57 expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.649941:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f41073d4800/0xa1d8aa9164aa3f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3f57 expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.649950:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4800, rc 0) 00000100:00100000:1.0:1788940909.649990:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:14427:x1875840068591232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940909.649996:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940909.650047:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068591232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788940909.650061:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f41073d5c00/0xa1d8aa9164aa3f57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3f5e expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.650070:0:14427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f41073d5c00/0xa1d8aa9164aa3f57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa3f5e expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940909.650131:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068591360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788940909.650162:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940909.650177:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f410634a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788940909.650224:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068591360 00000100:00100000:1.0:1788940909.650228:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068591360 00000100:00100000:1.0:1788940909.650249:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788940909.650255:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:14427:x1875840068591360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788940909.650269:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788940909.650291:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788940909.650294:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788940909.650371:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:14427:x1875840068591360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940909.650379:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788940909.650410:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068591360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788940909.650461:0:14427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788940909.650468:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f41073d5c00/0xa1d8aa9164aa3f57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3f5e expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940909.650477:0:14427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f41073d5c00/0xa1d8aa9164aa3f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa3f5e expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940910.088556:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940911.116041:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940912.136463:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940912.136709:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940912.136762:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068591488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940912.136847:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940912.137289:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068591488 00000100:00100000:1.0:1788940912.137299:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068591488 00000100:00100000:1.0:1788940912.137370:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788940912.137380:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a03a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068591488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940912.137419:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940912.137481:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a03a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068591488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940912.137488:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788940912.137551:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940912.137703:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068591488:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788940913.160380:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940913.674664:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788940913.674670:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788940913.674674:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f410f4f3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940913.674689:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f410f4f3800 using connection 192.168.202.117@tcp/0@lo 00000100:00100000:2.0:1788940913.674708:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f413a038000 x1875840068591872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940913.674764:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:340eef01-7b53-49af-9aa3-2abb708ce8bb:3303:1875840068591616:0@lo:400:kworker.0 00000100:00100000:2.0:1788940913.674884:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940913.675094:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068592256:0@lo:400:kworker.0 00000100:00100000:2.0:1788940913.675125:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940913.675151:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788940913.675156:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068591744:0@lo:400:kworker.0 00000100:00100000:2.0:1788940913.675177:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940913.675225:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068591872:0@lo:8:kworker.0 00000100:00100000:2.0:1788940913.675246:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940913.675270:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068592000:0@lo:400:kworker.0 00000100:00100000:2.0:1788940913.675290:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940913.675304:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940913.675309:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068592128:0@lo:400:kworker.0 00000100:00100000:2.0:1788940913.675326:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940913.675353:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068591616 00000100:00100000:2.0:1788940913.675360:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068591616 00000100:00100000:2.0:1788940913.675401:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788940913.675419:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3303:x1875840068591616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940913.676568:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3303:x1875840068591616:12345-0@lo:400:kworker.0 Request processed in 1144us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940913.676579:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788940913.676626:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068592256 00000100:00100000:2.0:1788940913.676631:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068592256 00000100:00100000:2.0:1788940913.676663:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068592000 00000100:00100000:2.0:1788940913.676665:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068592000 00000100:00100000:2.0:1788940913.676674:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068592128 00000100:00100000:2.0:1788940913.676676:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068592128 00000100:00100000:2.0:1788940913.676689:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788940913.676695:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a03b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068592256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940913.676733:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a03b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068592256:12345-0@lo:400:kworker.0 Request processed in 39us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940913.676739:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788940913.676749:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940913.676753:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a03b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068592000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940913.676777:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a03b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068592000:12345-0@lo:400:kworker.0 Request processed in 24us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940913.676782:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788940913.676791:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788940913.677404:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068592128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940913.677450:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875840068592128:12345-0@lo:400:kworker.0 Request processed in 652us (2121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940913.677467:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788940913.677493:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068591744 00000100:00100000:2.0:1788940913.677498:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068591744 00000100:00100000:2.0:1788940913.677541:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068591872 00000100:00100000:2.0:1788940913.677545:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068591872 00000100:00100000:2.0:1788940913.677555:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940913.677561:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068591744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940913.677591:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068591744:12345-0@lo:400:kworker.0 Request processed in 30us (2413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940913.677596:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940913.677606:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940913.677610:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a03a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3300:x1875840068591872:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788940913.677637:0:15116:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 554 last 0 00000020:00000080:2.0:1788940913.677664:0:15116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa1d8aa9164aa3f65 00002000:00100000:2.0:1788940913.677680:0:15116:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f411d15f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788940913.677684:0:15116:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788940913.677687:0:15116:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788940913.678207:0:15116:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788940913.678237:0:15116:0:(import.c:65:import_set_state_nolock()) ffff8f411d159800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940913.678285:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a03a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1875840068591872:12345-0@lo:8:kworker.0 Request processed in 672us (3036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940913.678291:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788940913.678356:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068591744:0@lo:400:kworker.0 00000100:00100000:2.0:1788940913.678370:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:340eef01-7b53-49af-9aa3-2abb708ce8bb:3303:1875840068591616:0@lo:400:kworker.0 00010000:00080000:2.0:1788940913.678385:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a038380 x1875840068592256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940913.678409:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068592256:0@lo:400:kworker.0 00000100:00080000:2.0:1788940913.678445:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788940913.678489:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a039500 x1875840068592128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940913.678499:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3301:1875840068592128:0@lo:400:kworker.0 00010000:00080000:2.0:1788940913.678511:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a038a80 x1875840068592000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940913.678518:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068592000:0@lo:400:kworker.0 00010000:00080000:2.0:1788940913.678549:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a038000 x1875840068591872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788940938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788940913.678562:0:3300:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788940913.678572:0:3300:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788940913.678578:0:3300:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788940913.678580:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8f410f4f3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788940913.678602:0:3300:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788940913.678608:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3300:1875840068591872:0@lo:8:kworker.0 00000004:00080000:2.0:1788940913.678651:0:14454:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788940913.678669:0:14454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a66e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14454:1875840068592512:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788940913.678704:0:14454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940913.678724:0:14454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940913.678739:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068592384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940913.678761:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940913.678790:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068592512 00000100:00100000:2.0:1788940913.678794:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068592512 00000100:00100000:2.0:1788940913.678839:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940913.678846:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14454:x1875840068592512:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788940913.680515:0:14453:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:3.0:1788940913.683041:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940913.683072:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068592384 00000100:00100000:3.0:1788940913.683102:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068592384 00000100:00100000:3.0:1788940913.683154:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940913.683163:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875840068592384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788940913.683212:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788940913.683292:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875840068592384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (4530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940913.683298:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:0.0:1788940913.688306:0:14453:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 554992115709ns, next at 0ns, rc = 0 00010000:00080000:0.0:1788940913.691553:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f413a66ce00 x1875840068592384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788940929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940913.691586:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068592384:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1788940913.695920:0:15116:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788940913.695939:0:15116:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788940913.695945:0:15116:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1788940913.725512:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.725528:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bf4c593/0xa1d8aa9164aa3f6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.725545:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.725549:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.725556:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bf4c593/0xa1d8aa9164aa3f6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.725574:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bf4c593/0xa1d8aa9164aa3f6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.725584:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bf4c593/0xa1d8aa9164aa3f6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.725592:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bf4c593/0xa1d8aa9164aa3f6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.725616:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940913.725653:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940913.725663:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bf4c593/0xa1d8aa9164aa3f6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.725674:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7a00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940913.725679:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bf4c593/0xa1d8aa9164aa3f6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.725703:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bf4c593/0xa1d8aa9164aa3f6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.725724:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bf4c593/0xa1d8aa9164aa3f6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.725732:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bf4c593/0xa1d8aa9164aa3f6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.725754:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.725756:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.725759:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.728645:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.728658:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d459f59/0xa1d8aa9164aa3f73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.728674:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.728679:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.728685:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d459f59/0xa1d8aa9164aa3f73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.728705:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d459f59/0xa1d8aa9164aa3f73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.728716:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d459f59/0xa1d8aa9164aa3f73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.728725:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d459f59/0xa1d8aa9164aa3f73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.728751:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940913.728766:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940913.728772:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d459f59/0xa1d8aa9164aa3f73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.728780:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7600 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.728785:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d459f59/0xa1d8aa9164aa3f73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.728795:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d459f59/0xa1d8aa9164aa3f73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.728812:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d459f59/0xa1d8aa9164aa3f73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.728819:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d459f59/0xa1d8aa9164aa3f73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.728844:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.728846:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.728848:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.729303:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.729310:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac27c5a3/0xa1d8aa9164aa3f7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729319:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.729322:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.729327:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac27c5a3/0xa1d8aa9164aa3f7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729337:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac27c5a3/0xa1d8aa9164aa3f7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729345:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac27c5a3/0xa1d8aa9164aa3f7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729352:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac27c5a3/0xa1d8aa9164aa3f7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729368:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940913.729376:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940913.729381:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac27c5a3/0xa1d8aa9164aa3f7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729399:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6800 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.729403:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac27c5a3/0xa1d8aa9164aa3f7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729411:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac27c5a3/0xa1d8aa9164aa3f7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729423:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac27c5a3/0xa1d8aa9164aa3f7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729430:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac27c5a3/0xa1d8aa9164aa3f7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729444:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.729447:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.729448:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.729888:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.729894:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3f81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729903:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.729906:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.729910:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3f81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729920:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3f81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729936:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3f81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729942:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3f81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729956:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940913.729965:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940913.729969:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3f81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729976:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7000 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.729978:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3f81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729985:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3f81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.729997:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3f81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.730004:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009945a42c/0xa1d8aa9164aa3f81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.730017:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.730025:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.730027:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.735654:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.735666:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3f88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.735682:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.735687:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.735693:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3f88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.735706:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3f88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.735717:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3f88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.735724:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3f88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.735750:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940913.735931:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940913.735940:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3f88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.735950:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7200 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940913.735955:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3f88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.735965:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3f88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.735984:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3f88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.736005:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea7557eb/0xa1d8aa9164aa3f88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.736034:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.736036:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.736038:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.740619:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.740632:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a5b12e/0xa1d8aa9164aa3f8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.740651:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.740656:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.740663:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a5b12e/0xa1d8aa9164aa3f8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.740685:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019a5b12e/0xa1d8aa9164aa3f8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.740695:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a5b12e/0xa1d8aa9164aa3f8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.740702:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019a5b12e/0xa1d8aa9164aa3f8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.740727:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940913.740741:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940913.740748:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019a5b12e/0xa1d8aa9164aa3f8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.740756:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6200 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.740762:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a5b12e/0xa1d8aa9164aa3f8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.740922:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a5b12e/0xa1d8aa9164aa3f8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.741009:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019a5b12e/0xa1d8aa9164aa3f8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.741071:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019a5b12e/0xa1d8aa9164aa3f8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.741112:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.741116:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.741118:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.741617:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.741623:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3f96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.741634:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.741637:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.741642:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3f96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.741653:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3f96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.741663:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3f96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.741669:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3f96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.741693:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940913.741726:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940913.741734:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3f96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.741743:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940913.741747:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3f96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.741756:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3f96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.741770:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3f96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.741777:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa3f96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.741791:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.741793:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.741794:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.745618:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.745631:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3f9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.745663:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.745669:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.745678:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3f9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.745694:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3f9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.745706:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3f9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.745714:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3f9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.745739:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940913.745757:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940913.745764:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3f9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788940913.747650:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788940913.747662:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa3fa4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.747677:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788940913.747681:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940913.747686:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa3fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.747701:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa3fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.747713:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa3fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.747722:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa3fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.747747:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940913.748299:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:0.0:1788940913.748665:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788940913.752233:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.752248:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa3fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.752262:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f43600 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940913.752267:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa3fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.752277:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa3fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.752301:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa3fa4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.752309:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa3fa4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.752328:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.752330:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.752332:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.752336:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.752337:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.753163:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050200 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.753168:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3f9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.753177:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3f9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.753216:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3f9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.753224:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3f9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.753262:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.753265:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.753267:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.754520:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.754533:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dff33d6/0xa1d8aa9164aa3fab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.754549:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.754553:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.754560:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dff33d6/0xa1d8aa9164aa3fab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.754574:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dff33d6/0xa1d8aa9164aa3fab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.754583:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dff33d6/0xa1d8aa9164aa3fab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.754591:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dff33d6/0xa1d8aa9164aa3fab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.754625:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940913.754845:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940913.754852:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dff33d6/0xa1d8aa9164aa3fab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.754860:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050800 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940913.754869:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dff33d6/0xa1d8aa9164aa3fab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.754878:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dff33d6/0xa1d8aa9164aa3fab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.754893:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dff33d6/0xa1d8aa9164aa3fab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.754900:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dff33d6/0xa1d8aa9164aa3fab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.754914:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.754916:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.754917:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.755232:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.755239:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045fa5450/0xa1d8aa9164aa3fb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755247:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.755251:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.755254:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045fa5450/0xa1d8aa9164aa3fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755264:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045fa5450/0xa1d8aa9164aa3fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755272:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045fa5450/0xa1d8aa9164aa3fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755279:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045fa5450/0xa1d8aa9164aa3fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755298:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940913.755329:0:16078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940913.755335:0:16078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045fa5450/0xa1d8aa9164aa3fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.755343:0:16078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050000 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940913.755346:0:16078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045fa5450/0xa1d8aa9164aa3fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.755354:0:16078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045fa5450/0xa1d8aa9164aa3fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.755366:0:16078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045fa5450/0xa1d8aa9164aa3fb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.755380:0:16078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045fa5450/0xa1d8aa9164aa3fb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.755393:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.755395:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.755396:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.755694:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.755700:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b2974be/0xa1d8aa9164aa3fb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755710:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.755719:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.755724:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b2974be/0xa1d8aa9164aa3fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755734:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b2974be/0xa1d8aa9164aa3fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755743:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b2974be/0xa1d8aa9164aa3fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755752:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b2974be/0xa1d8aa9164aa3fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755765:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940913.755774:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940913.755779:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b2974be/0xa1d8aa9164aa3fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755785:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051800 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.755788:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b2974be/0xa1d8aa9164aa3fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755795:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b2974be/0xa1d8aa9164aa3fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755806:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b2974be/0xa1d8aa9164aa3fb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755824:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b2974be/0xa1d8aa9164aa3fb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.755838:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.755840:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.755842:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.756330:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.756338:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006904341d/0xa1d8aa9164aa3fc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756349:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.756352:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.756357:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006904341d/0xa1d8aa9164aa3fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756367:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006904341d/0xa1d8aa9164aa3fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756376:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006904341d/0xa1d8aa9164aa3fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756383:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006904341d/0xa1d8aa9164aa3fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756399:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940913.756410:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940913.756420:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006904341d/0xa1d8aa9164aa3fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756427:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051000 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.756431:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006904341d/0xa1d8aa9164aa3fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756439:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006904341d/0xa1d8aa9164aa3fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756450:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006904341d/0xa1d8aa9164aa3fc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756458:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006904341d/0xa1d8aa9164aa3fc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756471:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.756473:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.756474:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.756899:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.756905:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ae6d29/0xa1d8aa9164aa3fc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756915:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.756918:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.756922:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081ae6d29/0xa1d8aa9164aa3fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756943:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081ae6d29/0xa1d8aa9164aa3fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756952:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081ae6d29/0xa1d8aa9164aa3fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756959:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081ae6d29/0xa1d8aa9164aa3fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.756975:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940913.757247:0:16078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940913.760995:0:16078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081ae6d29/0xa1d8aa9164aa3fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.761010:0:16078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.761015:0:16078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ae6d29/0xa1d8aa9164aa3fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.761029:0:16078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081ae6d29/0xa1d8aa9164aa3fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.761056:0:16078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081ae6d29/0xa1d8aa9164aa3fc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.761065:0:16078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081ae6d29/0xa1d8aa9164aa3fc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.761109:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.761111:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.761114:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.761987:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.761997:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c281b4e/0xa1d8aa9164aa3fce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.762012:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.762017:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.762024:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c281b4e/0xa1d8aa9164aa3fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.762037:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c281b4e/0xa1d8aa9164aa3fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.762047:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c281b4e/0xa1d8aa9164aa3fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.762055:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c281b4e/0xa1d8aa9164aa3fce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.762074:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940913.762100:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940913.762105:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c281b4e/0xa1d8aa9164aa3fce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.762123:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.762127:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c281b4e/0xa1d8aa9164aa3fce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.762134:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c281b4e/0xa1d8aa9164aa3fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.762148:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c281b4e/0xa1d8aa9164aa3fce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.762155:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c281b4e/0xa1d8aa9164aa3fce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.762173:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.762174:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.762176:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.763115:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.763125:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3fd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.763137:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.763141:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.763147:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.763158:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.763177:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.763207:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.763229:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940913.763425:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940913.763433:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.763441:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940913.763445:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.763454:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.763469:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3fd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.763476:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044a1737d/0xa1d8aa9164aa3fd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.763494:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.763496:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.763497:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.763846:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.763853:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e41fb39/0xa1d8aa9164aa3fdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.763863:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.763867:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.763871:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e41fb39/0xa1d8aa9164aa3fdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.763881:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e41fb39/0xa1d8aa9164aa3fdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.763890:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e41fb39/0xa1d8aa9164aa3fdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.763897:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e41fb39/0xa1d8aa9164aa3fdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.763930:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940913.764361:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.764368:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b184cae/0xa1d8aa9164aa3fe3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764565:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.764569:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.764573:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b184cae/0xa1d8aa9164aa3fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764583:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b184cae/0xa1d8aa9164aa3fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764591:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b184cae/0xa1d8aa9164aa3fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764597:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b184cae/0xa1d8aa9164aa3fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764613:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788940913.764625:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940913.764630:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e41fb39/0xa1d8aa9164aa3fdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764637:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050a00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.764645:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e41fb39/0xa1d8aa9164aa3fdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764653:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e41fb39/0xa1d8aa9164aa3fdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764666:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e41fb39/0xa1d8aa9164aa3fdc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764673:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e41fb39/0xa1d8aa9164aa3fdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764689:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940913.764692:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b184cae/0xa1d8aa9164aa3fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764698:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051200 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.764701:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b184cae/0xa1d8aa9164aa3fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764708:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b184cae/0xa1d8aa9164aa3fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764717:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b184cae/0xa1d8aa9164aa3fe3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764725:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b184cae/0xa1d8aa9164aa3fe3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.764744:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.764746:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.764747:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.765165:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.765172:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033bc960/0xa1d8aa9164aa3fea lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.765179:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.765182:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.765213:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033bc960/0xa1d8aa9164aa3fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.765224:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033bc960/0xa1d8aa9164aa3fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.765232:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033bc960/0xa1d8aa9164aa3fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.765239:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000033bc960/0xa1d8aa9164aa3fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.765257:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940913.765265:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940913.765270:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000033bc960/0xa1d8aa9164aa3fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.765289:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050600 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.765292:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000033bc960/0xa1d8aa9164aa3fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.765301:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000033bc960/0xa1d8aa9164aa3fea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.765313:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000033bc960/0xa1d8aa9164aa3fea lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.765321:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033bc960/0xa1d8aa9164aa3fea lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.765335:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.765336:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.765338:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.765956:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.765963:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beee1dd7/0xa1d8aa9164aa3ff1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.765973:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.765975:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.765979:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beee1dd7/0xa1d8aa9164aa3ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.765988:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000beee1dd7/0xa1d8aa9164aa3ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.766001:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000beee1dd7/0xa1d8aa9164aa3ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.766007:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000beee1dd7/0xa1d8aa9164aa3ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.766023:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940913.766033:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940913.766038:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000beee1dd7/0xa1d8aa9164aa3ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.766044:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050400 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.766047:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000beee1dd7/0xa1d8aa9164aa3ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.766054:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000beee1dd7/0xa1d8aa9164aa3ff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.766065:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000beee1dd7/0xa1d8aa9164aa3ff1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.766071:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000beee1dd7/0xa1d8aa9164aa3ff1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.766332:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.766339:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.766341:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.766409:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.766964:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.766972:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000733195c5/0xa1d8aa9164aa3ff8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.766984:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.766987:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.766991:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000733195c5/0xa1d8aa9164aa3ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.767002:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000733195c5/0xa1d8aa9164aa3ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.767010:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000733195c5/0xa1d8aa9164aa3ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.767017:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000733195c5/0xa1d8aa9164aa3ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.767139:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788940913.767721:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940913.767729:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000733195c5/0xa1d8aa9164aa3ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.767739:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940913.767743:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000733195c5/0xa1d8aa9164aa3ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.767752:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000733195c5/0xa1d8aa9164aa3ff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.767769:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000733195c5/0xa1d8aa9164aa3ff8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.767777:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000733195c5/0xa1d8aa9164aa3ff8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940913.776285:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.776294:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940913.776297:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.779981:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.779996:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3fff lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.780012:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.780017:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.780024:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3fff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.780048:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3fff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.780058:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3fff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.780067:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3fff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.780099:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940913.780116:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940913.780122:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3fff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.780131:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142050200 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.780136:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3fff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.780146:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3fff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.780164:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3fff lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.780171:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083d884c3/0xa1d8aa9164aa3fff lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.781016:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.781020:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.781022:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.781964:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.781974:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aeacf04/0xa1d8aa9164aa4006 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.781989:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.781993:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.781999:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002aeacf04/0xa1d8aa9164aa4006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.782013:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002aeacf04/0xa1d8aa9164aa4006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.782022:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aeacf04/0xa1d8aa9164aa4006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.782030:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002aeacf04/0xa1d8aa9164aa4006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.782060:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788940913.782714:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.782719:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3f717e2/0xa1d8aa9164aa400d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.782733:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.782735:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.782738:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3f717e2/0xa1d8aa9164aa400d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.782746:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3f717e2/0xa1d8aa9164aa400d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.782752:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3f717e2/0xa1d8aa9164aa400d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.782757:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3f717e2/0xa1d8aa9164aa400d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.782771:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788940913.783208:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.783212:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000366873c6/0xa1d8aa9164aa4014 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783218:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.783220:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.783223:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000366873c6/0xa1d8aa9164aa4014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783229:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000366873c6/0xa1d8aa9164aa4014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783242:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000366873c6/0xa1d8aa9164aa4014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783246:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000366873c6/0xa1d8aa9164aa4014 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783256:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788940913.783267:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788940913.783272:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002aeacf04/0xa1d8aa9164aa4006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783277:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4142051400 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.783280:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002aeacf04/0xa1d8aa9164aa4006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783286:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002aeacf04/0xa1d8aa9164aa4006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783300:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002aeacf04/0xa1d8aa9164aa4006 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783305:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002aeacf04/0xa1d8aa9164aa4006 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783320:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940913.783326:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3f717e2/0xa1d8aa9164aa400d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783330:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f400218d800 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.783332:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3f717e2/0xa1d8aa9164aa400d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783336:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3f717e2/0xa1d8aa9164aa400d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783341:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3f717e2/0xa1d8aa9164aa400d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783345:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3f717e2/0xa1d8aa9164aa400d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783351:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940913.783354:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000366873c6/0xa1d8aa9164aa4014 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783357:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f400218d000 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940913.783359:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000366873c6/0xa1d8aa9164aa4014 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783363:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000366873c6/0xa1d8aa9164aa4014 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783387:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000366873c6/0xa1d8aa9164aa4014 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783391:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000366873c6/0xa1d8aa9164aa4014 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.783399:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.783400:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.783401:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940913.783406:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940913.783553:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.792106:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.792119:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6d50b1a/0xa1d8aa9164aa401b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.792137:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.792142:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.792149:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6d50b1a/0xa1d8aa9164aa401b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.792163:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6d50b1a/0xa1d8aa9164aa401b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.792175:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6d50b1a/0xa1d8aa9164aa401b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.792183:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6d50b1a/0xa1d8aa9164aa401b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.792237:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940913.792283:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940913.792293:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6d50b1a/0xa1d8aa9164aa401b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.792305:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f400218d200 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940913.792311:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6d50b1a/0xa1d8aa9164aa401b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.792321:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6d50b1a/0xa1d8aa9164aa401b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.792344:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6d50b1a/0xa1d8aa9164aa401b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.792353:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6d50b1a/0xa1d8aa9164aa401b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.792387:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940913.792390:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940913.792394:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.792753:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.792760:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4022 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.792768:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.792771:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.792775:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.792785:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.792792:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.792799:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.792822:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940913.792857:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940913.792864:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.792874:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f400218c600 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940913.792878:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.792900:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4022 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.792914:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4022 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.792921:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4022 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.792936:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940913.792938:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940913.792940:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788940913.793298:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788940913.793305:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001307aa17/0xa1d8aa9164aa4029 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.793314:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=555s v=(0 0) 00010000:00010000:2.0:1788940913.793324:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940913.793329:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001307aa17/0xa1d8aa9164aa4029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.793339:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001307aa17/0xa1d8aa9164aa4029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.793349:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001307aa17/0xa1d8aa9164aa4029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.793358:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001307aa17/0xa1d8aa9164aa4029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940913.793374:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940913.793579:0:16078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940913.793585:0:16078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001307aa17/0xa1d8aa9164aa4029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.793593:0:16078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f400218c400 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940913.793597:0:16078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001307aa17/0xa1d8aa9164aa4029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.793605:0:16078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001307aa17/0xa1d8aa9164aa4029 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.793616:0:16078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001307aa17/0xa1d8aa9164aa4029 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.793635:0:16078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001307aa17/0xa1d8aa9164aa4029 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940913.793650:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940913.793652:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940913.793653:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788940913.796116:0:15116:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788940913.796261:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14454:x1875840068592512:12345-0@lo:5:osp-pre-1-0.0 Request processed in 117409us (117550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940913.796274:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788940913.796389:0:14454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a66e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14454:1875840068592512:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788940913.796406:0:14454:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788940913.796620:0:14454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a66e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14454:1875840068592640:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788940913.796666:0:14454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940913.796711:0:14454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108344000 going to sleep for 11 seconds 00000100:00100000:2.0:1788940913.796732:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068592640 00000100:00100000:2.0:1788940913.796738:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068592640 00000100:00100000:2.0:1788940913.796782:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788940913.796793:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14454:x1875840068592640:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788940913.796845:0:15114:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000001:00100000:1.0:1788940913.810512:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788940913.816448:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14454:x1875840068592640:12345-0@lo:5:osp-pre-1-0.0 Request processed in 19650us (19776us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788940913.816463:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788940913.816965:0:14454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a66e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14454:1875840068592640:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788940913.816982:0:14454:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1788940914.184728:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940915.209879:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788940915.941274:0:16191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg217-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788940916.243882:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940917.256669:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068592768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940917.256740:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940917.257705:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068592768 00000100:00100000:0.0:1788940917.257716:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068592768 00000100:00100000:0.0:1788940917.257776:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940917.257786:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068592768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940917.257824:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788940917.258636:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940917.264168:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068592768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6373us (7417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940917.264183:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788940917.270032:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068592768:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788940917.270087:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940918.158598:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940918.159545:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036086272 00000100:00100000:2.0:1788940918.159557:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036086272 00000100:00100000:2.0:1788940918.159607:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 77 00000100:00100000:2.0:1788940918.159616:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2357:x1875840036086272:12345-192.168.202.17@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788940918.159644:0:14423:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 36ee986b-e339-4da7-8006-c8ec2882b900@192.168.202.17@tcp t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:2.0:1788940918.159674:0:14423:0:(genops.c:1384:class_connect()) connect: client 36ee986b-e339-4da7-8006-c8ec2882b900, cookie 0xa1d8aa9164aa4030 00000100:00080000:2.0:1788940918.159820:0:14423:0:(import.c:65:import_set_state_nolock()) ffff8f411d158000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940918.159895:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+5:2357:x1875840036086272:12345-192.168.202.17@tcp:250:mount.lustre.0 Request processed in 278us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940918.159904:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 77 00000100:00100000:3.0:1788940918.167706:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940918.167879:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036086400 00000100:00100000:2.0:1788940918.167890:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036086400 00000100:00100000:2.0:1788940918.167949:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 78 00000100:00100000:2.0:1788940918.167959:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+5:13764:x1875840036086400:12345-192.168.202.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788940918.167978:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940918.167995:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f400218cc00/0xa1d8aa9164aa4037 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2267be expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940918.168024:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f400218cc00/0xa1d8aa9164aa4037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267be expref: 6 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940918.168045:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f400218cc00/0xa1d8aa9164aa4037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267be expref: 6 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940918.168624:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f400218cc00, rc 0) 00000100:00100000:2.0:1788940918.168725:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+6:13764:x1875840036086400:12345-192.168.202.17@tcp:101:mount.lustre.0 Request processed in 766us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940918.168733:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 78 00000100:00100000:3.0:1788940918.179598:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940918.179875:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036086528 00000100:00100000:1.0:1788940918.179886:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036086528 00000100:00100000:1.0:1788940918.179960:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 79 00000100:00100000:1.0:1788940918.179971:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+6:13764:x1875840036086528:12345-192.168.202.17@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788940918.181591:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+6:13764:x1875840036086528:12345-192.168.202.17@tcp:501:mount.lustre.0 Request processed in 1614us (1995us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788940918.181606:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 79 00000100:00100000:1.0:1788940918.200947:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940918.208386:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036086656 00000100:00100000:2.0:1788940918.208404:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036086656 00000100:00100000:2.0:1788940918.208477:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 80 00000100:00100000:2.0:1788940918.208488:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+6:13764:x1875840036086656:12345-192.168.202.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788940918.208506:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940918.208526:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f400218c200/0xa1d8aa9164aa403e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2267c5 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940918.208557:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f400218c200/0xa1d8aa9164aa403e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267c5 expref: 7 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940918.208568:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f400218c200/0xa1d8aa9164aa403e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267c5 expref: 7 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940918.208576:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f400218c200, rc 0) 00000100:00100000:2.0:1788940918.208646:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+7:13764:x1875840036086656:12345-192.168.202.17@tcp:101:mount.lustre.0 Request processed in 159us (7709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940918.208653:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 80 00000100:00100000:3.0:1788940918.212607:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940918.212734:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036086784 00000100:00100000:1.0:1788940918.212745:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036086784 00000100:00100000:1.0:1788940918.212815:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 81 00000100:00100000:1.0:1788940918.212826:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+7:13764:x1875840036086784:12345-192.168.202.17@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788940918.213155:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+8:13764:x1875840036086784:12345-192.168.202.17@tcp:501:mount.lustre.0 Request processed in 330us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940918.213164:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 81 00000100:00100000:0.0:1788940918.215050:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940918.215129:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036086912 00000100:00100000:3.0:1788940918.215139:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036086912 00000100:00100000:2.0:1788940918.215314:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 82 00000100:00100000:2.0:1788940918.215327:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+8:13764:x1875840036086912:12345-192.168.202.17@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788940918.215658:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+8:13764:x1875840036086912:12345-192.168.202.17@tcp:503:mount.lustre.0 Request processed in 332us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940918.215673:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 82 00000100:00100000:3.0:1788940918.225563:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940918.227136:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036087040 00000100:00100000:1.0:1788940918.227152:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036087040 00000100:00100000:1.0:1788940918.227268:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 83 00000100:00100000:1.0:1788940918.227279:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+8:13782:x1875840036087040:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940918.227635:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+8:13782:x1875840036087040:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 357us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940918.227643:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 83 00000100:00100000:0.0:1788940918.253453:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940918.253544:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036087168 00000100:00100000:3.0:1788940918.253554:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036087168 00000100:00100000:3.0:1788940918.253616:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 84 00000100:00100000:3.0:1788940918.253627:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+8:13782:x1875840036087168:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788940918.253939:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+8:13782:x1875840036087168:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 312us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940918.253955:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 84 00000100:00100000:0.0:1788940918.269704:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940918.269974:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036087296 00000100:00100000:1.0:1788940918.269987:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036087296 00000100:00100000:1.0:1788940918.270054:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 85 00000100:00100000:1.0:1788940918.270064:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+8:13764:x1875840036087296:12345-192.168.202.17@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788940918.270082:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940918.270100:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f41073d4000/0xa1d8aa9164aa4045 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2267ef expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940918.270149:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f41073d4000/0xa1d8aa9164aa4045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267ef expref: 9 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940918.270162:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f41073d4000/0xa1d8aa9164aa4045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267ef expref: 9 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940918.270172:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4000, rc 0) 00000100:00100000:1.0:1788940918.270437:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+9:13764:x1875840036087296:12345-192.168.202.17@tcp:101:mount.lustre.0 Request processed in 373us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940918.270445:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 85 00000100:00100000:1.0:1788940918.276703:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940918.277022:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036087424 00000100:00100000:2.0:1788940918.277042:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036087424 00000100:00100000:2.0:1788940918.277108:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 86 00000100:00100000:2.0:1788940918.277118:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+9:13764:x1875840036087424:12345-192.168.202.17@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788940918.277145:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788940918.277170:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788940918.277174:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788940918.277177:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788940918.277179:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00010000:00010000:3.0:1788940918.280523:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940918.286746:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+9:13764:x1875840036087424:12345-192.168.202.17@tcp:256:mount.lustre.0 Request processed in 9616us (10043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940918.286773:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 86 00000100:00100000:0.0:1788940918.294063:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940918.294274:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036087552 00000100:00100000:1.0:1788940918.294284:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036087552 00000100:00100000:1.0:1788940918.294342:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 87 00000100:00100000:1.0:1788940918.294350:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41370eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+9:13764:x1875840036087552:12345-192.168.202.17@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788940918.294367:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940918.294383:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f41073d5400/0xa1d8aa9164aa404c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2267f6 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940918.294410:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f41073d5400/0xa1d8aa9164aa404c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267f6 expref: 10 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940918.294420:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f41073d5400/0xa1d8aa9164aa404c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267f6 expref: 10 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940918.294429:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d5400, rc 0) 00000100:00100000:1.0:1788940918.294741:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41370eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+10:13764:x1875840036087552:12345-192.168.202.17@tcp:101:mount.lustre.0 Request processed in 390us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940918.294947:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 87 00000100:00100000:1.0:1788940918.298135:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940918.299981:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036087680 00000100:00100000:2.0:1788940918.299998:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036087680 00000100:00100000:2.0:1788940918.300076:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 88 00000100:00100000:2.0:1788940918.300089:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+10:13764:x1875840036087680:12345-192.168.202.17@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788940918.300966:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+10:13764:x1875840036087680:12345-192.168.202.17@tcp:501:mount.lustre.0 Request processed in 874us (2836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940918.300978:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 88 00000100:00100000:0.0:1788940918.311032:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940918.311957:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036087808 00000100:00100000:1.0:1788940918.311969:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036087808 00000100:00100000:1.0:1788940918.312032:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 89 00000100:00100000:1.0:1788940918.312051:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+10:13764:x1875840036087808:12345-192.168.202.17@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788940918.321429:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+10:13764:x1875840036087808:12345-192.168.202.17@tcp:503:mount.lustre.0 Request processed in 9366us (10395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940918.321446:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 89 00000100:00100000:0.0:1788940918.328797:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940918.328978:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036087936 00000100:00100000:2.0:1788940918.328990:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036087936 00000100:00100000:2.0:1788940918.329071:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 90 00000100:00100000:2.0:1788940918.329084:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+10:13787:x1875840036087936:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940918.329640:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+10:13787:x1875840036087936:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 557us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940918.329656:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 90 00000100:00100000:3.0:1788940918.335786:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940918.339029:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036088064 00000100:00100000:1.0:1788940918.339057:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036088064 00000100:00100000:1.0:1788940918.339148:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 91 00000100:00100000:1.0:1788940918.339161:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+10:13787:x1875840036088064:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940918.343293:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+10:13787:x1875840036088064:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 4121us (7517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940918.343313:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 91 00000100:00100000:0.0:1788940918.360836:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940918.360984:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036088576 00000100:00100000:2.0:1788940918.360995:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036088576 00000100:00100000:2.0:1788940918.361071:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 92 00000100:00100000:2.0:1788940918.361082:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+10:2360:x1875840036088576:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940918.361172:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+10:2360:x1875840036088576:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 91us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940918.361181:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 92 00000100:00100000:0.0:1788940918.367236:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940918.367335:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036088192 00000100:00100000:2.0:1788940918.367345:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036088192 00000100:00100000:2.0:1788940918.367410:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 4 00000100:00100000:2.0:1788940918.367419:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1875840036088192:12345-192.168.202.17@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788940918.367452:0:14430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 15a33589-b4ad-4ff7-837c-6a5163a69b6e@192.168.202.17@tcp t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:2.0:1788940918.367502:0:14430:0:(genops.c:1384:class_connect()) connect: client 15a33589-b4ad-4ff7-837c-6a5163a69b6e, cookie 0xa1d8aa9164aa4053 00000004:00100000:2.0:1788940918.367531:0:14430:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788940918.367538:0:14430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788940918.418125:0:14430:0:(import.c:65:import_set_state_nolock()) ffff8f41414fc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788940918.418314:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:2357:x1875840036088192:12345-192.168.202.17@tcp:38:mount.lustre.0 Request processed in 50893us (51130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940918.418568:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 4 00000100:00100000:3.0:1788940918.422367:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940918.422639:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940918.422680:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036088320 00000100:00100000:3.0:1788940918.422689:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036088320 00000100:00100000:3.0:1788940918.422741:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036088448 00000100:00100000:3.0:1788940918.422744:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036088448 00000100:00100000:3.0:1788940918.422775:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:3.0:1788940918.422786:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:0:x1875840036088320:12345-192.168.202.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788940918.422829:0:14431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788940918.422922:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:0:x1875840036088320:12345-192.168.202.17@tcp:41:mount.lustre.0 Request processed in 137us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940918.422930:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:3.0:1788940918.422948:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00100000:3.0:1788940918.422955:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:13764:x1875840036088448:12345-192.168.202.17@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788940918.422965:0:14431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788940918.422985:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:13764:x1875840036088448:12345-192.168.202.17@tcp:41:mount.lustre.0 Request processed in 31us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940918.422991:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00080000:1.0:1788940918.423659:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940918.427075:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940918.427562:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036088704 00000100:00100000:3.0:1788940918.427574:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036088704 00000100:00100000:3.0:1788940918.427682:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:3.0:1788940918.427694:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:13764:x1875840036088704:12345-192.168.202.17@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788940918.427810:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:13764:x1875840036088704:12345-192.168.202.17@tcp:40:mount.lustre.0 Request processed in 119us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940918.427818:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:0.0:1788940918.431578:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940918.431659:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940918.431739:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940918.431885:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036089088 00000100:00100000:3.0:1788940918.431896:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036089088 00000100:00100000:3.0:1788940918.431946:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:3.0:1788940918.431956:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:13764:x1875840036089088:12345-192.168.202.17@tcp:33:mount.lustre.0 00000100:00100000:2.0:1788940918.434952:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036088832 00000100:00100000:2.0:1788940918.434969:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036088832 00000100:00100000:2.0:1788940918.435019:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036088960 00000100:00100000:2.0:1788940918.435023:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036088960 00000100:00100000:2.0:1788940918.435052:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00100000:2.0:1788940918.435060:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875840036088832:12345-192.168.202.17@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788940918.435110:0:15115:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 15a33589-b4ad-4ff7-837c-6a5163a69b6e@192.168.202.17@tcp t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:2.0:1788940918.435153:0:15115:0:(genops.c:1384:class_connect()) connect: client 15a33589-b4ad-4ff7-837c-6a5163a69b6e, cookie 0xa1d8aa9164aa405a 00002000:00100000:2.0:1788940918.435164:0:15115:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 15a33589-b4ad-4ff7-837c-6a5163a69b6e/ffff8f411d15b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788940918.435175:0:15115:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788940918.435920:0:15115:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788940918.435957:0:15115:0:(import.c:65:import_set_state_nolock()) ffff8f411d15c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940918.436051:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:2357:x1875840036088832:12345-192.168.202.17@tcp:8:mount.lustre.0 Request processed in 989us (4480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940918.436061:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00100000:2.0:1788940918.436084:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:2.0:1788940918.436090:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875840036088960:12345-192.168.202.17@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788940918.436109:0:15115:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 15a33589-b4ad-4ff7-837c-6a5163a69b6e@192.168.202.17@tcp t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:2.0:1788940918.436130:0:15115:0:(genops.c:1384:class_connect()) connect: client 15a33589-b4ad-4ff7-837c-6a5163a69b6e, cookie 0xa1d8aa9164aa4061 00002000:00100000:2.0:1788940918.436148:0:15115:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 15a33589-b4ad-4ff7-837c-6a5163a69b6e/ffff8f411d15e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788940918.436167:0:15115:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788940918.437103:0:15115:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788940918.438593:0:15115:0:(import.c:65:import_set_state_nolock()) ffff8f411d15d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940918.438680:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:2357:x1875840036088960:12345-192.168.202.17@tcp:8:mount.lustre.0 Request processed in 2585us (7018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940918.438692:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 10 00000004:00080000:3.0:1788940918.443945:0:14432:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 11922us 00000004:00200000:3.0:1788940918.475689:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788940918.475835:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:13764:x1875840036089088:12345-192.168.202.17@tcp:33:mount.lustre.0 Request processed in 43874us (44089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940918.475848:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:0.0:1788940918.726837:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940918.727519:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036089216 00000100:00100000:2.0:1788940918.727538:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036089216 00000100:00100000:2.0:1788940918.727674:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 8 00000100:00100000:2.0:1788940918.727686:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:13808:x1875840036089216:12345-192.168.202.17@tcp:101:mkdir.0 00010000:00010000:2.0:1788940918.727722:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940918.727752:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218ca00/0xa1d8aa9164aa4068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226820 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940918.727841:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218d400/0xa1d8aa9164aa406f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940918.727856:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218d400/0xa1d8aa9164aa406f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940918.727882:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218d400/0xa1d8aa9164aa406f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940918.727920:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940918.727924:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940918.727966:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218d400/0xa1d8aa9164aa406f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940918.727991:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218ca00/0xa1d8aa9164aa4068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226820 expref: 8 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940918.728011:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218d400/0xa1d8aa9164aa406f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226820 expref: 7 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940918.728020:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4111ce7500) 00010000:00010000:2.0:1788940918.728023:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940918.728026:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f400218d400, rc 0) 00000100:00100000:2.0:1788940918.728118:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:13808:x1875840036089216:12345-192.168.202.17@tcp:101:mkdir.0 Request processed in 433us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940918.728143:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 8 00000040:00080000:3.0:1788940918.731863:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788940918.796344:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:340eef01-7b53-49af-9aa3-2abb708ce8bb:3302:1875840068592896:0@lo:400:kworker.0 00000100:00100000:1.0:1788940918.796430:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940918.796477:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068593408:0@lo:400:kworker.0 00000100:00100000:1.0:1788940918.796503:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940918.796531:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940918.796537:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068593280:0@lo:400:kworker.0 00000100:00100000:1.0:1788940918.796558:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940918.800618:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068593024:0@lo:400:kworker.0 00000100:00100000:2.0:1788940918.800698:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940918.800740:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068593536:0@lo:400:kworker.0 00000100:00100000:2.0:1788940918.800841:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940918.800952:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788940918.800963:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f40039c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068593152:0@lo:400:kworker.0 00000100:00100000:2.0:1788940918.800989:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940918.801009:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068593664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940918.803531:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940918.803647:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068592896 00000100:00100000:2.0:1788940918.803658:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068592896 00000100:00100000:2.0:1788940918.803714:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788940918.803722:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3302:x1875840068592896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940918.805573:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068593664 00000100:00100000:1.0:1788940918.805585:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068593664 00000100:00100000:1.0:1788940918.805641:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940918.805651:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875840068593664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940918.805688:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788940918.806343:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3302:x1875840068592896:12345-0@lo:400:kworker.0 Request processed in 2618us (9909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940918.806354:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788940918.806983:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875840068593664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1329us (5948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940918.806991:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940918.807027:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068593408 00000100:00100000:1.0:1788940918.807043:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068593408 00000100:00100000:1.0:1788940918.807073:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068593280 00000100:00100000:1.0:1788940918.807075:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068593280 00000100:00100000:1.0:1788940918.807086:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068593536 00000100:00100000:1.0:1788940918.807088:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068593536 00000100:00100000:1.0:1788940918.807104:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940918.807112:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068593408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940918.807305:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068593024 00000100:00100000:2.0:1788940918.807310:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068593024 00000100:00100000:2.0:1788940918.807340:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068593152 00000100:00100000:2.0:1788940918.807343:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068593152 00000100:00100000:2.0:1788940918.807356:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940918.807362:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068593024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940918.809380:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068593024:12345-0@lo:400:kworker.0 Request processed in 2009us (8675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940918.809978:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068593408:12345-0@lo:400:kworker.0 Request processed in 2863us (13470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940918.809991:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940918.810023:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940918.810045:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068593280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940918.810089:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875840068593280:12345-0@lo:400:kworker.0 Request processed in 59us (13529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940918.810094:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940918.810107:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788940918.810114:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068593536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940918.810653:0:15115:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788940918.810664:0:15115:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788940918.810946:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788940918.810971:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788940918.810981:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875840068593152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940918.811043:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875840068593152:12345-0@lo:400:kworker.0 Request processed in 53us (10040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940918.811050:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788940918.812057:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068593664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940918.812078:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068593024:0@lo:400:kworker.0 00000100:00100000:3.0:1788940918.812112:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068593152:0@lo:400:kworker.0 00000100:00100000:1.0:1788940918.812515:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068593536:12345-0@lo:400:kworker.0 Request processed in 2399us (11670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940918.812526:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788940918.812559:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940918.812565:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940918.812604:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068593536:0@lo:400:kworker.0 00000100:00100000:1.0:1788940918.812642:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875840068593280:0@lo:400:kworker.0 00000100:00100000:1.0:1788940918.812652:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:340eef01-7b53-49af-9aa3-2abb708ce8bb:3302:1875840068592896:0@lo:400:kworker.0 00000100:00100000:1.0:1788940918.812664:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f40039c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068593408:0@lo:400:kworker.0 00000001:00100000:0.0:1788940918.965419:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 15a33589-b4ad-4ff7-837c-6a5163a69b6e 00000001:00080000:0.0:1788940918.965439:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1788940919.304611:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940920.328670:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940920.645309:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940920.645367:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036089344 00000100:00100000:3.0:1788940920.645386:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036089344 00000100:00080000:1.0:1788940920.645440:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940920.645469:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00100000:3.0:1788940920.645483:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:13861:x1875840036089344:12345-192.168.202.17@tcp:41:lfs.0 00000004:00000024:3.0:1788940920.645528:0:14430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788940920.645633:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:13861:x1875840036089344:12345-192.168.202.17@tcp:41:lfs.0 Request processed in 154us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940920.645642:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00100000:0.0:1788940920.650216:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940920.650399:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036089472 00000100:00100000:1.0:1788940920.650410:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036089472 00000100:00100000:1.0:1788940920.650493:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00100000:1.0:1788940920.650504:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:13861:x1875840036089472:12345-192.168.202.17@tcp:13:lfs.0 00002000:00000024:1.0:1788940920.650543:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940920.650634:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:13861:x1875840036089472:12345-192.168.202.17@tcp:13:lfs.0 Request processed in 131us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940920.650642:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00080000:2.0:1788940920.651117:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940920.653548:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940920.653665:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036089600 00000100:00100000:1.0:1788940920.653675:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036089600 00000100:00100000:1.0:1788940920.653736:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:1.0:1788940920.653746:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:13861:x1875840036089600:12345-192.168.202.17@tcp:13:lfs.0 00002000:00000024:1.0:1788940920.653786:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940920.653876:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:13861:x1875840036089600:12345-192.168.202.17@tcp:13:lfs.0 Request processed in 131us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940920.653884:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00080000:2.0:1788940920.654058:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940920.859649:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940920.859765:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036089728 00000100:00100000:2.0:1788940920.859777:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036089728 00000100:00100000:2.0:1788940920.859845:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 94 00000100:00100000:2.0:1788940920.859857:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+10:13895:x1875840036089728:12345-192.168.202.17@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788940920.859875:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940920.859894:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f400218ca00/0xa1d8aa9164aa4076 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226827 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940920.859923:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f400218ca00/0xa1d8aa9164aa4076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226827 expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940920.859935:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f400218ca00/0xa1d8aa9164aa4076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226827 expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940920.859944:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f400218ca00, rc 0) 00000100:00100000:2.0:1788940920.860073:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+11:13895:x1875840036089728:12345-192.168.202.17@tcp:101:mount.lustre.0 Request processed in 215us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940920.860089:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 94 00000100:00100000:3.0:1788940920.864894:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940920.865167:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036089856 00000100:00100000:0.0:1788940920.865178:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036089856 00000100:00100000:0.0:1788940920.865260:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 95 00000100:00100000:0.0:1788940920.865271:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+11:13895:x1875840036089856:12345-192.168.202.17@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788940920.865586:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+11:13895:x1875840036089856:12345-192.168.202.17@tcp:501:mount.lustre.0 Request processed in 315us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940920.865595:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 95 00000100:00100000:3.0:1788940920.876958:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940920.877220:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036089984 00000100:00100000:0.0:1788940920.877230:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036089984 00000100:00100000:0.0:1788940920.877351:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 96 00000100:00100000:0.0:1788940920.877362:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+11:13895:x1875840036089984:12345-192.168.202.17@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788940920.877630:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+11:13895:x1875840036089984:12345-192.168.202.17@tcp:503:mount.lustre.0 Request processed in 269us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940920.877639:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 96 00000100:00100000:3.0:1788940920.885073:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940920.886945:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036090112 00000100:00100000:2.0:1788940920.886976:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036090112 00000100:00100000:2.0:1788940920.887065:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 97 00000100:00100000:2.0:1788940920.887075:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+11:13900:x1875840036090112:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940920.887684:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+11:13900:x1875840036090112:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 608us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940920.887694:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 97 00000100:00100000:3.0:1788940920.903757:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940920.903886:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036090240 00000100:00100000:2.0:1788940920.903897:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036090240 00000100:00100000:2.0:1788940920.904041:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 98 00000100:00100000:2.0:1788940920.904053:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41128d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+11:13900:x1875840036090240:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940920.904509:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41128d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+11:13900:x1875840036090240:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 457us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940920.904535:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 98 00000100:00100000:3.0:1788940920.910617:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940920.911986:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036090368 00000100:00100000:1.0:1788940920.912001:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036090368 00000100:00100000:1.0:1788940920.912119:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 99 00000100:00100000:1.0:1788940920.912145:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+11:13895:x1875840036090368:12345-192.168.202.17@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788940920.912162:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940920.912180:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f41073d4c00/0xa1d8aa9164aa407d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226851 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940920.912227:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f41073d4c00/0xa1d8aa9164aa407d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226851 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940920.912240:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f41073d4c00/0xa1d8aa9164aa407d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226851 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940920.912249:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4c00, rc 0) 00000100:00100000:1.0:1788940920.912321:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+12:13895:x1875840036090368:12345-192.168.202.17@tcp:101:mount.lustre.0 Request processed in 179us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940920.912328:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 99 00000100:00100000:3.0:1788940920.917491:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940920.917617:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036090496 00000100:00100000:2.0:1788940920.917629:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036090496 00000100:00100000:2.0:1788940920.917695:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 100 00000100:00100000:2.0:1788940920.917706:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+12:13895:x1875840036090496:12345-192.168.202.17@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788940920.917740:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788940920.917766:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788940920.917771:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788940920.917774:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788940920.917777:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788940920.921622:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+12:13895:x1875840036090496:12345-192.168.202.17@tcp:256:mount.lustre.0 Request processed in 3907us (4128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940920.921637:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 100 00000100:00100000:3.0:1788940920.929761:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940920.930511:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036090624 00000100:00100000:1.0:1788940920.930522:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036090624 00000100:00100000:1.0:1788940920.930584:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 101 00000100:00100000:1.0:1788940920.930595:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+12:13895:x1875840036090624:12345-192.168.202.17@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788940920.930613:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940920.930631:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f41073d4a00/0xa1d8aa9164aa4084 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226858 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940920.930661:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f41073d4a00/0xa1d8aa9164aa4084 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226858 expref: 13 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940920.930672:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f41073d4a00/0xa1d8aa9164aa4084 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226858 expref: 13 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940920.930701:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f41073d4a00, rc 0) 00000100:00100000:1.0:1788940920.930868:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+13:13895:x1875840036090624:12345-192.168.202.17@tcp:101:mount.lustre.0 Request processed in 274us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940920.930876:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 101 00000100:00100000:1.0:1788940920.939669:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940920.939964:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036090752 00000100:00100000:2.0:1788940920.939988:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036090752 00000100:00100000:2.0:1788940920.940063:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 102 00000100:00100000:2.0:1788940920.940074:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+13:13895:x1875840036090752:12345-192.168.202.17@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788940920.940443:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+13:13895:x1875840036090752:12345-192.168.202.17@tcp:501:mount.lustre.0 Request processed in 369us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940920.940452:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 102 00000100:00100000:3.0:1788940920.942659:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940920.942719:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036090880 00000100:00100000:1.0:1788940920.942729:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036090880 00000100:00100000:1.0:1788940920.942903:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 103 00000100:00100000:1.0:1788940920.942913:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+13:13895:x1875840036090880:12345-192.168.202.17@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788940920.943280:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+13:13895:x1875840036090880:12345-192.168.202.17@tcp:503:mount.lustre.0 Request processed in 265us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940920.943290:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 103 00000100:00100000:3.0:1788940920.947531:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940920.947593:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036091008 00000100:00100000:2.0:1788940920.947607:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036091008 00000100:00100000:2.0:1788940920.947665:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 104 00000100:00100000:2.0:1788940920.947675:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+13:13904:x1875840036091008:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788940920.947943:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+13:13904:x1875840036091008:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 267us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940920.947951:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 104 00000100:00100000:3.0:1788940920.954697:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940920.967759:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036091136 00000100:00100000:1.0:1788940920.967776:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036091136 00000100:00100000:1.0:1788940920.967841:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 105 00000100:00100000:1.0:1788940920.967851:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+13:13904:x1875840036091136:12345-192.168.202.17@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788940920.968128:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+13:13904:x1875840036091136:12345-192.168.202.17@tcp:502:llog_process_th.0 Request processed in 276us (13438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940920.968138:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 105 00000100:00100000:3.0:1788940920.975581:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940920.975681:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036091264 00000100:00100000:1.0:1788940920.975692:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036091264 00000100:00100000:1.0:1788940920.975742:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:1.0:1788940920.975750:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1875840036091264:12345-192.168.202.17@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788940920.975780:0:14429:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ad5c5f24-5413-4c25-9f52-f7f2bcff2739@192.168.202.17@tcp t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:1.0:1788940920.975829:0:14429:0:(genops.c:1384:class_connect()) connect: client ad5c5f24-5413-4c25-9f52-f7f2bcff2739, cookie 0xa1d8aa9164aa408b 00000004:00100000:1.0:1788940920.975861:0:14429:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788940920.975992:0:14429:0:(import.c:65:import_set_state_nolock()) ffff8f400200b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940920.976066:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:2357:x1875840036091264:12345-192.168.202.17@tcp:38:mount.lustre.0 Request processed in 316us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940920.976074:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:3.0:1788940920.981788:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940920.981830:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940920.981900:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036091520 00000100:00100000:2.0:1788940920.981910:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036091520 00000100:00100000:2.0:1788940920.981987:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036091392 00000100:00100000:2.0:1788940920.981991:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036091392 00000100:00100000:2.0:1788940920.982018:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:2.0:1788940920.982029:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+7:13895:x1875840036091520:12345-192.168.202.17@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788940920.982074:0:14430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788940920.982148:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a696d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+7:13895:x1875840036091520:12345-192.168.202.17@tcp:41:mount.lustre.0 Request processed in 120us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940920.982156:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:2.0:1788940920.982175:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00100000:2.0:1788940920.982182:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:0:x1875840036091392:12345-192.168.202.17@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788940920.982241:0:14430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788940920.982266:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:0:x1875840036091392:12345-192.168.202.17@tcp:41:mount.lustre.0 Request processed in 84us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940920.982273:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00080000:3.0:1788940920.982457:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940920.988797:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940920.991260:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036091648 00000100:00100000:2.0:1788940920.991275:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036091648 00000100:00100000:2.0:1788940920.991356:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00100000:2.0:1788940920.991367:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:13895:x1875840036091648:12345-192.168.202.17@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788940920.991476:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a696a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:13895:x1875840036091648:12345-192.168.202.17@tcp:40:mount.lustre.0 Request processed in 110us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940920.991484:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00100000:3.0:1788940920.997541:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940920.997830:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036091776 00000100:00100000:2.0:1788940920.997840:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036091776 00000100:00100000:2.0:1788940920.997900:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:2.0:1788940920.997908:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875840036091776:12345-192.168.202.17@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788940920.997942:0:15114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ad5c5f24-5413-4c25-9f52-f7f2bcff2739@192.168.202.17@tcp t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:2.0:1788940920.997975:0:15114:0:(genops.c:1384:class_connect()) connect: client ad5c5f24-5413-4c25-9f52-f7f2bcff2739, cookie 0xa1d8aa9164aa4092 00002000:00100000:2.0:1788940920.997988:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ad5c5f24-5413-4c25-9f52-f7f2bcff2739/ffff8f411d15a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788940920.997999:0:15114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788940920.998125:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788940920.998156:0:15114:0:(import.c:65:import_set_state_nolock()) ffff8f4112974000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788940920.999287:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a695880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:2357:x1875840036091776:12345-192.168.202.17@tcp:8:mount.lustre.0 Request processed in 1371us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940920.999300:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:2.0:1788940921.001587:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940921.001625:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940921.001685:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036091904 00000100:00100000:1.0:1788940921.001695:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036091904 00000100:00100000:1.0:1788940921.001736:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00100000:1.0:1788940921.001745:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875840036091904:12345-192.168.202.17@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788940921.001777:0:16306:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ad5c5f24-5413-4c25-9f52-f7f2bcff2739@192.168.202.17@tcp t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:1.0:1788940921.001805:0:16306:0:(genops.c:1384:class_connect()) connect: client ad5c5f24-5413-4c25-9f52-f7f2bcff2739, cookie 0xa1d8aa9164aa4099 00002000:00100000:1.0:1788940921.001816:0:16306:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ad5c5f24-5413-4c25-9f52-f7f2bcff2739/ffff8f400200f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788940921.001828:0:16306:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788940921.002099:0:16306:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788940921.002129:0:16306:0:(import.c:65:import_set_state_nolock()) ffff8f4002008800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788940921.002214:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:2357:x1875840036091904:12345-192.168.202.17@tcp:8:mount.lustre.0 Request processed in 469us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940921.002223:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00100000:0.0:1788940921.003268:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036092032 00000100:00100000:0.0:1788940921.003276:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036092032 00000100:00100000:0.0:1788940921.003323:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 1 00000100:00100000:0.0:1788940921.003331:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:13895:x1875840036092032:12345-192.168.202.17@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788940921.003414:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788940921.003483:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:13895:x1875840036092032:12345-192.168.202.17@tcp:33:mount.lustre.0 Request processed in 152us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940921.003491:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 1 00000100:00100000:2.0:1788940921.160807:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940921.160919:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036092160 00000100:00100000:1.0:1788940921.160930:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036092160 00000100:00100000:1.0:1788940921.160997:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 14 00000100:00100000:1.0:1788940921.161017:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:13925:x1875840036092160:12345-192.168.202.17@tcp:101:mkdir.0 00010000:00010000:1.0:1788940921.161039:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940921.161065:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa40a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226882 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940921.161150:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa40a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940921.161165:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa40a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940921.161181:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa40a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940921.161248:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940921.161251:0:14429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940921.161273:0:14429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa40a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940921.161432:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f41073d5a00/0xa1d8aa9164aa40a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226882 expref: 8 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940921.161454:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa40a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226882 expref: 7 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940921.161462:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4111ce7500) 00010000:00010000:1.0:1788940921.161465:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940921.161468:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6200, rc 0) 00000100:00100000:1.0:1788940921.161536:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+7:13925:x1875840036092160:12345-192.168.202.17@tcp:101:mkdir.0 Request processed in 530us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940921.161543:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 14 00010000:00010000:3.0:1788940921.354152:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940922.377959:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940922.378119:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940922.378141:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068593792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788940922.378228:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940922.378486:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068593792 00000100:00100000:1.0:1788940922.378495:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068593792 00000100:00100000:1.0:1788940922.378587:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940922.378596:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068593792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940922.378630:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940922.378681:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068593792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940922.378688:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788940922.378735:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068593792:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788940922.378956:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940923.400737:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788940923.452282:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad5c5f24-5413-4c25-9f52-f7f2bcff2739 00000001:00100000:3.0:1788940923.452298:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 15a33589-b4ad-4ff7-837c-6a5163a69b6e 00000001:00100000:0.0:1788940923.520035:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 15a33589-b4ad-4ff7-837c-6a5163a69b6e 00000001:00100000:0.0:1788940923.520054:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ad5c5f24-5413-4c25-9f52-f7f2bcff2739 00000100:00100000:3.0:1788940923.915234:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940923.915259:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068593920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788940923.915342:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940923.915974:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068593920 00000100:00100000:1.0:1788940923.915995:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068593920 00000100:00080000:3.0:1788940923.916220:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788940923.916223:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940923.916234:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068593920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940923.916271:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940923.916335:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068593920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940923.916343:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788940923.916362:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788940923.916543:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068593920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940923.920327:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:340eef01-7b53-49af-9aa3-2abb708ce8bb:3303:1875840068594048:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.920391:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940923.920427:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068594560:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.920450:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940923.920479:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940923.920485:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068594176:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.920506:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940923.920534:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068594560 00000100:00100000:1.0:1788940923.920541:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068594560 00000100:00100000:1.0:1788940923.920606:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788940923.920615:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068594560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.920669:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875840068594560:12345-0@lo:400:kworker.0 Request processed in 55us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940923.920676:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788940923.920696:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068594176 00000100:00100000:1.0:1788940923.920699:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068594176 00000100:00100000:1.0:1788940923.920717:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788940923.920723:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068594176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.920746:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068594176:12345-0@lo:400:kworker.0 Request processed in 24us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940923.920751:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788940923.920833:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940923.920857:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068594176:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.920865:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3303:1875840068594560:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.921284:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068594432:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.921313:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940923.921391:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068594304:0@lo:400:kworker.0 00000100:00100000:2.0:1788940923.931103:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068594048 00000100:00100000:2.0:1788940923.931121:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068594048 00000100:00100000:2.0:1788940923.931218:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788940923.931228:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3303:x1875840068594048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940923.931327:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3303:x1875840068594048:12345-0@lo:400:kworker.0 Request processed in 100us (10935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940923.931334:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788940923.931399:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:340eef01-7b53-49af-9aa3-2abb708ce8bb:3303:1875840068594048:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.934871:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940923.936556:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068594432 00000100:00100000:1.0:1788940923.936569:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068594432 00000100:00100000:1.0:1788940923.936628:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068594304 00000100:00100000:1.0:1788940923.936631:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068594304 00000100:00100000:1.0:1788940923.936646:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788940923.936654:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068594432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.936734:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875840068594432:12345-0@lo:400:kworker.0 Request processed in 81us (15420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940923.936741:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788940923.936756:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788940923.936777:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068594304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.936808:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068594304:12345-0@lo:400:kworker.0 Request processed in 32us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940923.936813:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788940923.936831:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788940923.936860:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3302:1875840068594432:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.936962:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068594304:0@lo:400:kworker.0 00000001:00100000:1.0:1788940924.012181:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad5c5f24-5413-4c25-9f52-f7f2bcff2739 00000001:02000400:2.0:1788940924.235927:0:16396:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788940924.425293:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940925.455068:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940926.127660:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940926.127707:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940926.127735:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940926.127761:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940926.127780:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940926.127803:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940926.127831:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940926.128469:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036092544 00000100:00100000:2.0:1788940926.129772:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036092544 00000100:00100000:2.0:1788940926.129874:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036093056 00000100:00100000:2.0:1788940926.129877:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036093056 00000100:00100000:2.0:1788940926.129895:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036092672 00000100:00100000:2.0:1788940926.129898:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036092672 00000100:00100000:2.0:1788940926.129910:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036092928 00000100:00100000:2.0:1788940926.129912:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036092928 00000100:00100000:2.0:1788940926.129930:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:2.0:1788940926.129949:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2360:x1875840036092544:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940926.130042:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2360:x1875840036092544:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 95us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940926.130049:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:2.0:1788940926.130068:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00100000:2.0:1788940926.130075:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+5:2360:x1875840036093056:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940926.130099:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+5:2360:x1875840036093056:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 25us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940926.130105:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00100000:2.0:1788940926.130117:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:2.0:1788940926.130123:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2360:x1875840036092672:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940926.130143:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2360:x1875840036092672:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 21us (2339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940926.130150:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:2.0:1788940926.130161:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 8 00000100:00100000:2.0:1788940926.130166:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+5:2360:x1875840036092928:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940926.130206:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+5:2360:x1875840036092928:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 39us (2374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940926.130213:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 8 00000100:00100000:2.0:1788940926.130241:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036092800 00000100:00100000:2.0:1788940926.130245:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036092800 00000100:00100000:2.0:1788940926.130285:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036092416 00000100:00100000:2.0:1788940926.130289:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036092416 00000100:00100000:2.0:1788940926.130307:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 20 00000100:00100000:2.0:1788940926.130321:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:2360:x1875840036092800:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940926.130468:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036092288 00000100:00100000:3.0:1788940926.130473:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036092288 00000100:00100000:3.0:1788940926.130503:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 107 00000100:00100000:3.0:1788940926.130511:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+13:2360:x1875840036092288:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:3.0:1788940926.130538:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+13:2360:x1875840036092288:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 28us (2890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940926.130545:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 107 00000100:00100000:2.0:1788940926.130748:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:2360:x1875840036092800:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 426us (3010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940926.130755:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 20 00000100:00100000:2.0:1788940926.130768:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 21 00000100:00100000:2.0:1788940926.130774:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:2360:x1875840036092416:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940926.130799:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:2360:x1875840036092416:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 25us (3018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940926.130804:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 21 00000100:00080000:2.0:1788940926.130836:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940926.130840:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940926.130842:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940926.473318:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940927.496623:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068594688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940927.496728:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940927.496852:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068594688 00000100:00100000:0.0:1788940927.496864:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068594688 00000100:00100000:0.0:1788940927.496968:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940927.496980:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068594688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940927.497028:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940927.497105:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068594688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940927.497113:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940927.497166:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068594688:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788940927.497454:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788940927.497681:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788940928.244764:0:16543:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6c057740 20000000:00000080:2.0:1788940928.244794:0:16543:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f40027b7400 uarg=0000000000000000 20000000:01000000:2.0:1788940928.244848:0:16543:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788940928.244857:0:16543:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788940928.244863:0:16543:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788940928.246965:0:16544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788940928.247169:0:16543:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788940928.259654:0:16543:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788940928.259702:0:16543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940928.259731:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f41073d5600/0xa1d8aa9164aa3da5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3d9e expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940928.259740:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa3df2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3deb expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940928.259778:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f41073d4600/0xa1d8aa9164aa3f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa3f1f expref: 18 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940928.259789:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f41073d5400/0xa1d8aa9164aa404c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267f6 expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940928.259797:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f41073d4a00/0xa1d8aa9164aa4084 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226858 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940928.259806:0:16543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940928.259865:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f41073d4a00/0xa1d8aa9164aa4084 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226858 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940928.259886:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f41073d4a00/0xa1d8aa9164aa4084 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226858 expref: 12 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940928.259905:0:16543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a66ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875840068594816:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940928.260075:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f41073d5400/0xa1d8aa9164aa404c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267f6 expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940928.260084:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f41073d5400/0xa1d8aa9164aa404c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267f6 expref: 12 pid: 14422 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940928.260093:0:16543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875840068594944:192.168.202.17@tcp:104: 00010000:00010000:2.0:1788940928.260139:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f41073d4600/0xa1d8aa9164aa3f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa3f1f expref: 18 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940928.260159:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f41073d4600/0xa1d8aa9164aa3f26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3f1f expref: 18 pid: 14422 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940928.260170:0:16543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875840068595072:0@lo:104: 00000100:00100000:2.0:1788940928.260278:0:16543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940928.260432:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068595072 00000100:00100000:0.0:1788940928.260443:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068595072 00000100:00100000:0.0:1788940928.260579:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940928.260592:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:340eef01-7b53-49af-9aa3-2abb708ce8bb+3:16543:x1875840068595072:12345-0@lo:104: 00010000:00010000:0.0:1788940928.260609:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa3f26 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.261709:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788940928.261735:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a039500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:340eef01-7b53-49af-9aa3-2abb708ce8bb+3:16543:x1875840068595072:12345-0@lo:104: Request processed in 1142us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940928.261746:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788940928.261836:0:16078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940928.261845:0:16078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa3f26 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.261855:0:16078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:1.0:1788940928.261860:0:16078:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa3f26 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.261872:0:16078:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa3f26 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940928.261880:0:16078:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa3f26 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940928.261886:0:16078:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940928.261978:0:16078:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3f26 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.261986:0:16078:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940928.262012:0:16078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3f26 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.262019:0:16078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6c00/0xa1d8aa9164aa3f1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3f26 expref: -99 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.262035:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940928.262037:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940928.262038:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940928.262053:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:340eef01-7b53-49af-9aa3-2abb708ce8bb:3301:1875840068595200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940928.262100:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940928.262277:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068595200 00000100:00100000:0.0:1788940928.262285:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068595200 00010000:00010000:0.0:1788940928.262320:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f41073d4600/0xa1d8aa9164aa3f26 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3f1f expref: 19 pid: 14422 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940928.262349:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940928.262358:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3301:x1875840068595200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940928.262372:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940928.262378:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f41073d4600/0xa1d8aa9164aa3f26 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3f1f expref: 19 pid: 14422 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.262388:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f41073d4600/0xa1d8aa9164aa3f26 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3f1f expref: 19 pid: 14422 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.262409:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940928.262445:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3301:x1875840068595200:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940928.262452:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788940928.262730:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:340eef01-7b53-49af-9aa3-2abb708ce8bb:3301:1875840068595200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940928.262932:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa3df2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa3deb expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940928.262955:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa3df2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3deb expref: 18 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940928.262968:0:16543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875840068595328:0@lo:104: 00000100:00100000:2.0:1788940928.263000:0:16543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940928.263032:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f41073d5600/0xa1d8aa9164aa3da5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa1d8aa9164aa3d9e expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940928.263040:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f41073d5600/0xa1d8aa9164aa3da5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d9e expref: 18 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940928.263048:0:16543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875840068595456:0@lo:104: 00000100:00100000:2.0:1788940928.263068:0:16543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940928.263091:0:16543:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4115f3fb40 going to sleep for 11 seconds 00010000:00010000:2.0:1788940928.263105:0:16543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f41073d4600/0xa1d8aa9164aa3f26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa3f1f expref: 18 pid: 14422 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940928.263218:0:14414:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788940928.263239:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068595328 00000100:00100000:1.0:1788940928.263243:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068595328 00000100:00100000:1.0:1788940928.263275:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068595456 00000100:00100000:1.0:1788940928.263277:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068595456 00000100:00100000:1.0:1788940928.263289:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940928.263303:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a039880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:340eef01-7b53-49af-9aa3-2abb708ce8bb+4:16543:x1875840068595328:12345-0@lo:104: 00010000:00010000:1.0:1788940928.263316:0:14414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa3df2 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.263358:0:14414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788940928.263363:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a039880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:340eef01-7b53-49af-9aa3-2abb708ce8bb+4:16543:x1875840068595328:12345-0@lo:104: Request processed in 68us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940928.263370:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940928.263383:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940928.263400:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a00a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:340eef01-7b53-49af-9aa3-2abb708ce8bb+3:16543:x1875840068595456:12345-0@lo:104: 00010000:00010000:1.0:1788940928.263407:0:14414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa3da5 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.263439:0:14414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788940928.263444:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a00a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:340eef01-7b53-49af-9aa3-2abb708ce8bb+3:16543:x1875840068595456:12345-0@lo:104: Request processed in 45us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940928.263449:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788940928.263700:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940928.263707:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa3df2 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.263715:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6400 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:1.0:1788940928.263719:0:14419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa3df2 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.263728:0:14419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa3df2 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940928.263735:0:14419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa3df2 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940928.263741:0:14419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940928.263767:0:14419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3df2 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.263773:0:14419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940928.263788:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3df2 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.263806:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc6400/0xa1d8aa9164aa3deb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3df2 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.263820:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940928.263823:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa1d8aa9164aa3da5 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.263829:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7c00 already unused, calling callback (ffffffffc1aa9c20) 10000000:00010000:1.0:1788940928.263832:0:14419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa1d8aa9164aa3da5 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.263840:0:14419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa1d8aa9164aa3da5 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940928.263846:0:14419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa1d8aa9164aa3da5 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940928.263850:0:14419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788940928.263860:0:14419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3da5 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.263865:0:14419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940928.263881:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3da5 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.263887:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.117@tcp lock: ffff8f412bfc7c00/0xa1d8aa9164aa3d9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa1d8aa9164aa3da5 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.263901:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940928.263906:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940928.263908:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940928.263914:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940928.263927:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:340eef01-7b53-49af-9aa3-2abb708ce8bb:3303:1875840068595712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940928.263973:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940928.264005:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068595712 00000100:00100000:1.0:1788940928.264009:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068595712 00010000:00010000:1.0:1788940928.264025:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f41073d5600/0xa1d8aa9164aa3da5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d9e expref: 19 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940928.264043:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940928.264048:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3303:x1875840068595712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940928.264057:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940928.264062:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f41073d5600/0xa1d8aa9164aa3da5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d9e expref: 19 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.264072:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f41073d5600/0xa1d8aa9164aa3da5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d9e expref: 19 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.264086:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940928.264121:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3303:x1875840068595712:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940928.264128:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788940928.264145:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:340eef01-7b53-49af-9aa3-2abb708ce8bb:3302:1875840068595584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940928.264170:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940928.264216:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068595584 00000100:00100000:1.0:1788940928.264220:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068595584 00010000:00010000:1.0:1788940928.264374:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa3df2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3deb expref: 19 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940928.264406:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940928.264411:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f585450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3302:x1875840068595584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940928.264419:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940928.264423:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa3df2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3deb expref: 19 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.264431:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa3df2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa1d8aa9164aa3deb expref: 19 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.264442:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940928.264465:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f585450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3302:x1875840068595584:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940928.264471:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788940928.264640:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:340eef01-7b53-49af-9aa3-2abb708ce8bb:3302:1875840068595584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940928.264658:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:340eef01-7b53-49af-9aa3-2abb708ce8bb:3303:1875840068595712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940928.264846:0:16543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875840068595072:0@lo:104: 00010000:00010000:2.0:1788940928.264883:0:16543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f4100031000/0xa1d8aa9164aa3df2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa3deb expref: 17 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940928.264905:0:16543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875840068595328:0@lo:104: 00010000:00010000:2.0:1788940928.264916:0:16543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f41073d5600/0xa1d8aa9164aa3da5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa1d8aa9164aa3d9e expref: 16 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940928.264925:0:16543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875840068595456:0@lo:104: 00000100:00100000:3.0:1788940928.273100:0:16543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a66ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875840068594816:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940928.277694:0:16543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1875840068594944:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940928.277757:0:16543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940928.279836:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940928.280615:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036093184 00000100:00100000:1.0:1788940928.280630:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036093184 00010000:00010000:1.0:1788940928.280681:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f41073d4a00/0xa1d8aa9164aa4084 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226858 expref: 13 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940928.280737:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:1.0:1788940928.280749:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a697100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36ee986b-e339-4da7-8006-c8ec2882b900+13:2358:x1875840036093184:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940928.280770:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940928.280777:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f41073d4a00/0xa1d8aa9164aa4084 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226858 expref: 13 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.280817:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f41073d4a00/0xa1d8aa9164aa4084 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226858 expref: 13 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.280839:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f41073d4a00/0xa1d8aa9164aa4084 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226858 expref: 13 pid: 14423 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940928.280873:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940928.280959:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a697100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:36ee986b-e339-4da7-8006-c8ec2882b900+12:2358:x1875840036093184:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 212us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940928.280968:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:3.0:1788940928.284138:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940928.284263:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036093312 00000100:00100000:0.0:1788940928.284277:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036093312 00010000:00010000:0.0:1788940928.284339:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f41073d5400/0xa1d8aa9164aa404c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267f6 expref: 12 pid: 14422 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940928.284383:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 8 00000100:00100000:0.0:1788940928.284395:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a694380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36ee986b-e339-4da7-8006-c8ec2882b900+12:2359:x1875840036093312:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940928.284434:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940928.284441:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f41073d5400/0xa1d8aa9164aa404c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267f6 expref: 12 pid: 14422 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.284457:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f41073d5400/0xa1d8aa9164aa404c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267f6 expref: 12 pid: 14422 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.284491:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f41073d5400/0xa1d8aa9164aa404c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2267f6 expref: 12 pid: 14422 timeout: 669 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.284513:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.284524:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.284546:0:14416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.284554:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.284561:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.284568:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.284575:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f400218dc00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940928.284579:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.284600:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.284622:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.284634:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940928.284696:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a694380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:36ee986b-e339-4da7-8006-c8ec2882b900+11:2359:x1875840036093312:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 303us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940928.284705:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 8 00010000:00010000:0.0:1788940928.284775:0:16543:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.284784:0:16543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940928.284791:0:16543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40ae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940928.524380:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940928.971903:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788940929.032686:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940929.032712:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068595840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940929.032787:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940929.032853:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068595840 00000100:00100000:0.0:1788940929.032861:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068595840 00000100:00100000:0.0:1788940929.032916:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788940929.032925:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068595840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940929.032998:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940929.033048:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068595840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940929.033260:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:340eef01-7b53-49af-9aa3-2abb708ce8bb:3301:1875840068595968:0@lo:400:kworker.0 00000100:00100000:2.0:1788940929.033402:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940929.033428:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068596480:0@lo:400:kworker.0 00000100:00100000:2.0:1788940929.033454:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940929.033471:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940929.033476:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068596096:0@lo:400:kworker.0 00000100:00100000:2.0:1788940929.033497:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940929.033525:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068595968 00000100:00100000:2.0:1788940929.033530:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068595968 00000100:00100000:2.0:1788940929.033580:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788940929.033588:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:3301:x1875840068595968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940929.033621:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:3301:x1875840068595968:12345-0@lo:400:kworker.0 Request processed in 35us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940929.033628:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788940929.033659:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068596480 00000100:00100000:2.0:1788940929.033662:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068596480 00000100:00100000:2.0:1788940929.033686:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788940929.033692:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a03ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068596480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940929.033721:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a03ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875840068596480:12345-0@lo:400:kworker.0 Request processed in 29us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940929.033737:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788940929.033757:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068596096 00000100:00100000:2.0:1788940929.033760:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068596096 00000100:00100000:2.0:1788940929.033786:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788940929.033792:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068596096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940929.033823:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a039500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068596096:12345-0@lo:400:kworker.0 Request processed in 31us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940929.033828:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788940929.034560:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788940929.034589:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940929.034595:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940929.034597:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940929.034701:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068596224:0@lo:400:kworker.0 00000100:00100000:0.0:1788940929.034743:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940929.034796:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068595840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940929.034816:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940929.034821:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068596352:0@lo:400:kworker.0 00000100:00100000:0.0:1788940929.034844:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940929.034871:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068596224 00000100:00100000:0.0:1788940929.034875:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068596224 00000100:00100000:0.0:1788940929.034902:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068596352 00000100:00100000:0.0:1788940929.034905:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068596352 00000100:00100000:0.0:1788940929.034925:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788940929.034932:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068596224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940929.034986:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875840068596224:12345-0@lo:400:kworker.0 Request processed in 54us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940929.034992:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788940929.035005:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788940929.035012:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068596352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940929.035040:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875840068596352:12345-0@lo:400:kworker.0 Request processed in 30us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940929.035045:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788940929.035073:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940929.035093:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3303:1875840068596352:0@lo:400:kworker.0 00000100:00100000:0.0:1788940929.035113:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875840068596224:0@lo:400:kworker.0 00000100:00100000:2.0:1788940929.037081:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068596096:0@lo:400:kworker.0 00000100:00100000:2.0:1788940929.037098:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:340eef01-7b53-49af-9aa3-2abb708ce8bb:3301:1875840068595968:0@lo:400:kworker.0 00000100:00100000:2.0:1788940929.037110:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3301:1875840068596480:0@lo:400:kworker.0 00010000:00010000:2.0:1788940929.551278:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940929.962843:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940929.963947:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036093440 00000100:00100000:2.0:1788940929.963961:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036093440 00000100:00100000:2.0:1788940929.964027:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 109 00000100:00100000:2.0:1788940929.964037:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+11:13778:x1875840036093440:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940929.964056:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940929.964077:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226889 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.964108:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226889 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.964119:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f400218dc00/0xa1d8aa9164aa40b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226889 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.964154:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f400218dc00, rc 0) 00000100:00100000:2.0:1788940929.964243:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+12:13778:x1875840036093440:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 Request processed in 206us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940929.964250:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 109 00000100:00100000:3.0:1788940929.971485:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940929.973557:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036093568 00000100:00100000:2.0:1788940929.973571:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036093568 00000100:00100000:2.0:1788940929.973639:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 110 00000100:00100000:2.0:1788940929.973651:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+12:13778:x1875840036093568:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940929.974037:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+12:13778:x1875840036093568:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 Request processed in 387us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940929.974046:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 110 00000100:00100000:2.0:1788940929.987596:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940929.990285:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036093696 00000100:00100000:0.0:1788940929.990304:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036093696 00000100:00100000:0.0:1788940929.990366:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 111 00000100:00100000:0.0:1788940929.990376:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+12:13778:x1875840036093696:12345-192.168.202.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940929.990632:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+12:13778:x1875840036093696:12345-192.168.202.17@tcp:503:ll_cfg_requeue.0 Request processed in 256us (3047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940929.990640:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 111 00000100:00100000:1.0:1788940929.999642:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940930.000162:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036093824 00000100:00100000:0.0:1788940930.000175:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036093824 00000100:00100000:0.0:1788940930.000257:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 112 00000100:00100000:0.0:1788940930.000270:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+12:13778:x1875840036093824:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940930.000286:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940930.000305:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4113b37600/0xa1d8aa9164aa40bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226890 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940930.000336:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4113b37600/0xa1d8aa9164aa40bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226890 expref: 13 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940930.000349:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4113b37600/0xa1d8aa9164aa40bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226890 expref: 13 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940930.000358:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37600, rc 0) 00000100:00100000:0.0:1788940930.000694:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:36ee986b-e339-4da7-8006-c8ec2882b900+13:13778:x1875840036093824:12345-192.168.202.17@tcp:101:ll_cfg_requeue.0 Request processed in 426us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940930.000704:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 112 00000100:00100000:2.0:1788940930.011103:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940930.011333:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036093952 00000100:00100000:0.0:1788940930.011346:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036093952 00000100:00100000:0.0:1788940930.011413:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 113 00000100:00100000:0.0:1788940930.011424:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41346c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+13:13778:x1875840036093952:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940930.011798:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41346c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+13:13778:x1875840036093952:12345-192.168.202.17@tcp:501:ll_cfg_requeue.0 Request processed in 375us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940930.011806:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 113 00000100:00100000:2.0:1788940930.017474:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940930.019130:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036094080 00000100:00100000:0.0:1788940930.019145:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036094080 00000100:00100000:0.0:1788940930.019243:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 114 00000100:00100000:0.0:1788940930.019257:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+13:13778:x1875840036094080:12345-192.168.202.17@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940930.019508:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+13:13778:x1875840036094080:12345-192.168.202.17@tcp:503:ll_cfg_requeue.0 Request processed in 254us (2046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940930.019518:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 114 10000000:01000000:2.0:1788940930.059132:0:14427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940930.059141:0:14427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f4112972000 from 10 10000000:01000000:2.0:1788940930.059147:0:14427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940930.059243:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f400218de00/0xa1d8aa9164aa40c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940930.059256:0:14427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f400218de00/0xa1d8aa9164aa40c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940930.059270:0:14427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f400218de00/0xa1d8aa9164aa40c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940930.059309:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a039f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068596608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940930.059388:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940930.059437:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4111439180 going to sleep for 11 seconds 00000100:00100000:0.0:1788940930.059595:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068596608 00000100:00100000:0.0:1788940930.059604:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068596608 00000100:00100000:0.0:1788940930.059668:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788940930.059680:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+16:14427:x1875840068596608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940930.059695:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940930.059710:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4113b36600/0xa1d8aa9164aa40ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa40c3 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940930.059742:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4113b36600/0xa1d8aa9164aa40ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa40c3 expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940930.059754:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4113b36600/0xa1d8aa9164aa40ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa40c3 expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940930.059778:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36600, rc 0) 00000100:00100000:0.0:1788940930.059827:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:14427:x1875840068596608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940930.059834:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788940930.059949:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a039f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068596608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940930.059974:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f400218de00/0xa1d8aa9164aa40c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa40ca expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940930.059984:0:14427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f400218de00/0xa1d8aa9164aa40c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa40ca expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940930.060055:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a696680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068596736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940930.060084:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940930.060112:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4106380300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940930.060287:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068596736 00000100:00100000:0.0:1788940930.060292:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068596736 00000100:00100000:0.0:1788940930.060326:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788940930.060334:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:14427:x1875840068596736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788940930.060610:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:14427:x1875840068596736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940930.060618:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788940930.060668:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a696680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068596736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940930.060698:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a696680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068596864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940930.060734:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940930.060825:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4106380300 going to sleep for 11 seconds 00000100:00100000:0.0:1788940930.062358:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068596864 00000100:00100000:0.0:1788940930.062374:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068596864 00000100:00100000:0.0:1788940930.062433:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788940930.062444:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:14427:x1875840068596864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940930.062743:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:14427:x1875840068596864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 301us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940930.062752:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788940930.064430:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a696680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068596864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788940930.074241:0:16623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788940930.074321:0:14427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788940930.074354:0:14427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788940930.074367:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f400218de00/0xa1d8aa9164aa40c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa40ca expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940930.074381:0:14427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f400218de00/0xa1d8aa9164aa40c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa40ca expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940930.074393:0:14427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788940930.074396:0:14427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f4118039800 from 10 10000000:01000000:2.0:1788940930.074399:0:14427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788940930.074442:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f400218d600/0xa1d8aa9164aa40d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940930.074450:0:14427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f400218d600/0xa1d8aa9164aa40d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940930.074462:0:14427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f400218d600/0xa1d8aa9164aa40d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940930.074491:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068596992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788940930.074585:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940930.074640:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4111439480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940930.074696:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068596992 00000100:00100000:0.0:1788940930.074705:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068596992 00000100:00100000:0.0:1788940930.074761:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788940930.074770:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+17:14427:x1875840068596992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788940930.074783:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940930.074795:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f4113b37200/0xa1d8aa9164aa40d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa40d1 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940930.074838:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f4113b37200/0xa1d8aa9164aa40d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa40d1 expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940930.074849:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f4113b37200/0xa1d8aa9164aa40d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa40d1 expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940930.074858:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37200, rc 0) 00000100:00100000:0.0:1788940930.074910:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:14427:x1875840068596992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940930.074918:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788940930.075098:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068596992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940930.075113:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f400218d600/0xa1d8aa9164aa40d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa40d8 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940930.075135:0:14427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f400218d600/0xa1d8aa9164aa40d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa40d8 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940930.075213:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068597120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940930.075241:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940930.075265:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4111439480 going to sleep for 11 seconds 00000100:00100000:1.0:1788940930.076621:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068597120 00000100:00100000:1.0:1788940930.076633:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068597120 00000100:00100000:1.0:1788940930.076673:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788940930.076682:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:14427:x1875840068597120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940930.076988:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:14427:x1875840068597120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940930.076997:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788940930.077044:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068597120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788940930.077088:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068597248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788940930.077134:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940930.077229:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4111439480 going to sleep for 11 seconds 00000100:00100000:0.0:1788940930.079404:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068597248 00000100:00100000:0.0:1788940930.079419:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068597248 00000100:00100000:0.0:1788940930.079482:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788940930.079492:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:14427:x1875840068597248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940930.079792:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:14427:x1875840068597248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 300us (2656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940930.079801:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788940930.085862:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a038000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068597248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788940930.088403:0:16624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788940930.088733:0:14427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788940930.088758:0:14427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788940930.088769:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f400218d600/0xa1d8aa9164aa40d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa40d8 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940930.088782:0:14427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f400218d600/0xa1d8aa9164aa40d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa40d8 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940930.088794:0:14427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788940930.088797:0:14427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f4002627000 from 10 10000000:01000000:0.0:1788940930.088814:0:14427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788940930.088850:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa40df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940930.088858:0:14427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa40df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940930.088869:0:14427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa40df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940930.088896:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134692d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068597376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788940930.088986:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940930.089038:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108e9cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788940930.089179:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068597376 00000100:00100000:2.0:1788940930.089214:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068597376 00000100:00100000:2.0:1788940930.089267:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788940930.089288:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4108066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+18:14427:x1875840068597376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788940930.089303:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940930.089318:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f400218da00/0xa1d8aa9164aa40e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa1d8aa9164aa40df expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940930.089343:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f400218da00/0xa1d8aa9164aa40e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa1d8aa9164aa40df expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940930.089355:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f400218da00/0xa1d8aa9164aa40e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa1d8aa9164aa40df expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940930.089377:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f400218da00, rc 0) 00000100:00100000:2.0:1788940930.089426:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4108066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:14427:x1875840068597376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940930.089433:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788940930.089728:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134692d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068597376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788940930.089747:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa40df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa40e6 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940930.089757:0:14427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa40df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa1d8aa9164aa40e6 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940930.089810:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a696680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068597504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940930.089838:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940930.089865:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4106380000 going to sleep for 11 seconds 00000100:00100000:1.0:1788940930.090063:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068597504 00000100:00100000:1.0:1788940930.090069:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068597504 00000100:00100000:1.0:1788940930.090109:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788940930.090117:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4116a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:14427:x1875840068597504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788940930.090419:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4116a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:14427:x1875840068597504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940930.090436:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788940930.090631:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a696680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068597504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788940930.090662:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413a696680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068597632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788940930.090703:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940930.090732:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4106380000 going to sleep for 11 seconds 00000100:00100000:0.0:1788940930.090781:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068597632 00000100:00100000:0.0:1788940930.090786:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068597632 00000100:00100000:0.0:1788940930.090817:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788940930.090824:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:14427:x1875840068597632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788940930.090998:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f585850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:14427:x1875840068597632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940930.091006:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788940930.091086:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413a696680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:340eef01-7b53-49af-9aa3-2abb708ce8bb:14427:1875840068597632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788940930.105406:0:16625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788940930.105670:0:14427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788940930.105691:0:14427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.117@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788940930.105702:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa40df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa40e6 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940930.105714:0:14427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.117@tcp lock: ffff8f4113b37000/0xa1d8aa9164aa40df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa1d8aa9164aa40e6 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940930.568501:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940931.242448:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940931.242497:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940931.242528:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940931.242554:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940931.242572:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940931.242593:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940931.242615:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940931.242642:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036094720 00000100:00100000:1.0:1788940931.242653:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036094720 00000100:00100000:1.0:1788940931.242712:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036094336 00000100:00100000:1.0:1788940931.242715:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036094336 00000100:00100000:1.0:1788940931.242735:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 25 00000100:00100000:1.0:1788940931.242744:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:2359:x1875840036094720:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940931.242819:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:2359:x1875840036094720:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 76us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940931.242827:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 25 00000100:00100000:1.0:1788940931.242844:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 26 00000100:00100000:1.0:1788940931.242877:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:2359:x1875840036094336:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940931.242906:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:2359:x1875840036094336:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940931.242921:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 26 00000100:00080000:1.0:1788940931.242940:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940931.243073:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036094208 00000100:00100000:2.0:1788940931.243079:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036094208 00000100:00100000:2.0:1788940931.243120:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 124 00000100:00100000:2.0:1788940931.243127:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+13:2359:x1875840036094208:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940931.243157:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f584050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:36ee986b-e339-4da7-8006-c8ec2882b900+13:2359:x1875840036094208:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 31us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940931.243163:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 124 00000100:00100000:2.0:1788940931.243233:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036094464 00000100:00100000:2.0:1788940931.243237:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036094464 00000100:00100000:2.0:1788940931.243259:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036094976 00000100:00100000:2.0:1788940931.243262:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036094976 00000100:00100000:2.0:1788940931.243274:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036094592 00000100:00100000:2.0:1788940931.243277:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036094592 00000100:00100000:2.0:1788940931.243288:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036094848 00000100:00100000:2.0:1788940931.243290:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036094848 00000100:00100000:2.0:1788940931.243305:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:2.0:1788940931.243310:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2359:x1875840036094464:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940931.243335:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2359:x1875840036094464:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 25us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940931.243341:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:2.0:1788940931.243353:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:2.0:1788940931.243358:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+5:2359:x1875840036094976:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940931.243389:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+5:2359:x1875840036094976:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 31us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940931.243395:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:2.0:1788940931.243407:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00100000:2.0:1788940931.243412:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2359:x1875840036094592:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940931.243433:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2359:x1875840036094592:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 21us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940931.243439:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00100000:2.0:1788940931.243449:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00100000:2.0:1788940931.243454:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+5:2359:x1875840036094848:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:2.0:1788940931.243474:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+5:2359:x1875840036094848:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 20us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940931.243478:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00080000:1.0:1788940931.243961:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940931.243965:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788940931.592393:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940932.005579:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.006025:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036095104 00000100:00100000:1.0:1788940932.006037:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036095104 00000100:00100000:1.0:1788940932.006103:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 15 00000100:00100000:1.0:1788940932.006113:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:14436:x1875840036095104:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940932.006135:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940932.006168:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa40ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226897 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006269:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa40f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006283:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa40f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006296:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa40f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006312:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa40fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006319:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa40fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006347:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa40fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006681:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa4102 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006690:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa4102 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006698:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa4102 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940932.006722:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940932.006726:0:14429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940932.006760:0:14429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa4102 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006772:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa40f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006779:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa40f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006786:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa40f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006793:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940932.006797:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa40f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006804:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa40f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006822:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4111ce7500) 00010000:00010000:1.0:1788940932.006825:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940932.006831:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa40f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006838:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa40f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006851:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa40fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006858:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa40fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006864:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa40fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006870:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940932.006873:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa40fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006879:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa40fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.006887:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f41129a4600) 00010000:00010000:1.0:1788940932.006889:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940932.006892:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa40fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.007992:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa40fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.008072:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa40ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226897 expref: 8 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.008087:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7000/0xa1d8aa9164aa4102 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226897 expref: 7 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.008095:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f41129a4700) 00010000:00010000:1.0:1788940932.008098:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940932.008100:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7000, rc 0) 00000100:00100000:1.0:1788940932.008642:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:14436:x1875840036095104:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 2526us (3071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940932.008652:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 15 00000100:00100000:2.0:1788940932.015568:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940932.015701:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036095360 00000100:00100000:0.0:1788940932.015712:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036095360 00000100:00100000:0.0:1788940932.015782:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 16 00000100:00100000:0.0:1788940932.015792:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:14436:x1875840036095360:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788940932.015815:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940932.015840:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4109 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22689e expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.015946:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4110 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.015961:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4110 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.015972:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4110 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.015983:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4117 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.015988:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4117 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.015992:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4117 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016372:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa411e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016379:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa411e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016383:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa411e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940932.016391:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788940932.016568:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4110 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016586:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4110 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016593:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4110 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016612:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940932.016616:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4110 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016625:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4110 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016637:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f41129a4700) 00010000:00010000:0.0:1788940932.016640:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940932.016645:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4110 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016650:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4110 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016664:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4117 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016669:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4117 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016674:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4117 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016678:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940932.016687:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4117 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016693:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4117 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016701:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f410ad9fd00) 00010000:00010000:0.0:1788940932.016704:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940932.016707:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4117 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.016712:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4117 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.017320:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4109 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22689e expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.017338:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37e00/0xa1d8aa9164aa411e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22689e expref: 9 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.017346:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9f900) 00010000:00010000:0.0:1788940932.017348:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940932.017351:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37e00, rc 0) 00000100:00100000:0.0:1788940932.017417:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a038000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:14436:x1875840036095360:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 1625us (1858us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788940932.017425:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 16 00000100:00100000:2.0:1788940932.023009:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.023224:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036095488 00000100:00100000:1.0:1788940932.023235:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036095488 00000100:00100000:1.0:1788940932.023290:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 17 00000100:00100000:1.0:1788940932.023299:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:14436:x1875840036095488:12345-192.168.202.17@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788940932.023399:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a039c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:14436:x1875840036095488:12345-192.168.202.17@tcp:59:lhsmtool_posix.0 Request processed in 101us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940932.023406:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 17 00000040:00080000:1.0:1788940932.041017:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788940932.093441:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.093608:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036095616 00000100:00100000:1.0:1788940932.093618:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036095616 00000100:00100000:1.0:1788940932.093696:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:1.0:1788940932.093706:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:14442:x1875840036095616:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:1.0:1788940932.093730:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940932.093768:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa412c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2268a5 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.093842:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4133 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.093857:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4133 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.093868:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4133 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.093881:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa413a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.093888:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa413a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.093894:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa413a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094133:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4133 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094142:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4133 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094149:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4133 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094155:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940932.094159:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4133 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094177:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4133 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094221:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4111ce7500) 00010000:00010000:1.0:1788940932.094225:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940932.094231:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4133 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094237:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4133 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094250:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa413a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094256:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa413a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094263:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa413a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094268:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940932.094271:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa413a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094287:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa413a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094295:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f41129a4600) 00010000:00010000:1.0:1788940932.094297:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940932.094301:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa413a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094316:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa413a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094351:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa412c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268a5 expref: 10 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094362:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4111ce7500) 00010000:00010000:1.0:1788940932.094365:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940932.094368:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa412c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268a5 expref: 10 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.094377:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6400, rc 0) 00000100:00100000:1.0:1788940932.094446:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:14442:x1875840036095616:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 741us (1015us total) trans 0 rc 301/301 00000100:00100000:1.0:1788940932.094453:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:2.0:1788940932.105010:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.105181:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036095744 00000100:00100000:1.0:1788940932.105247:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036095744 00000100:00100000:1.0:1788940932.105329:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:1.0:1788940932.105343:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:14442:x1875840036095744:12345-192.168.202.17@tcp:700:lfs.0 00000100:00100000:0.0:1788940932.105644:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:14442:x1875840036095744:12345-192.168.202.17@tcp:700:lfs.0 Request processed in 282us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940932.105666:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:2.0:1788940932.117957:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940932.118068:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036096000 00000100:00100000:0.0:1788940932.118080:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036096000 00000100:00100000:0.0:1788940932.118154:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00100000:0.0:1788940932.118162:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:14442:x1875840036096000:12345-192.168.202.17@tcp:36:lfs.0 00010000:00010000:0.0:1788940932.118278:0:14430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940932.118317:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218d400/0xa1d8aa9164aa406f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226820 expref: 9 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.118342:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4111ce7500) 00010000:00010000:0.0:1788940932.118348:0:14430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940932.118610:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.118628:0:14430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa40a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226882 expref: 5 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.118635:0:14430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.118669:0:14430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa40a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226882 expref: 5 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.118681:0:14430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa40a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226882 expref: 5 pid: 14429 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940932.118695:0:14430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134691f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14430:1875840068597760:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940932.118795:0:14430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108e9c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788940932.128795:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.129739:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036096128 00000100:00100000:1.0:1788940932.129756:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036096128 00010000:00010000:1.0:1788940932.129819:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa40a7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226882 expref: 6 pid: 14429 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940932.129885:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00100000:1.0:1788940932.129896:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a038a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:2360:x1875840036096128:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940932.129944:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940932.129953:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa40a7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226882 expref: 6 pid: 14429 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.129969:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa40a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226882 expref: 6 pid: 14429 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.129997:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4111ce7500) 00010000:00010000:1.0:1788940932.130005:0:14417:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.130016:0:14417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.130025:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.130050:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940932.130139:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a038a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:2360:x1875840036096128:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 244us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940932.130147:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 9 00010000:00010000:0.0:1788940932.132509:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa40a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226882 expref: 5 pid: 14429 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940932.132563:0:14430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134691f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14430:1875840068597760:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940932.132604:0:14430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.132616:0:14430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.133452:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.133494:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4148 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.133513:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4148 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.133526:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4148 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940932.136692:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788940932.136720:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.136733:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.136742:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.136749:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940932.136762:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.136772:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.136794:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f4111ce7500) 00010000:00010000:0.0:1788940932.136797:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940932.136803:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.136810:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4141 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940932.136835:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca29d438 reply state 00000000f598fbbc transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4148 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940932.136845:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788940932.137022:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a038380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+10:14442:x1875840036096000:12345-192.168.202.17@tcp:36:lfs.0 Request processed in 18852us (19073us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788940932.137034:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 19 00010000:00010000:1.0:1788940932.153254:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4148 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.153288:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4148 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.153297:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4148 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.153329:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940932.153335:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4148 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.153345:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4148 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.153366:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f410ad9fd00) 00010000:00010000:1.0:1788940932.153369:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940932.153376:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4148 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.153383:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4148 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940932.256410:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940932.256456:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036096256 00000100:00100000:0.0:1788940932.256469:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036096256 00000100:00100000:0.0:1788940932.256547:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 20 00000100:00100000:0.0:1788940932.256559:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:14450:x1875840036096256:12345-192.168.202.17@tcp:101:lctl.0 00010000:00010000:0.0:1788940932.256591:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940932.256626:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa414f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2268ac expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.256718:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4156 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.256756:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.256771:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940932.256825:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788940932.256829:0:14429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940932.256879:0:14429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4156 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.256948:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa414f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268ac expref: 11 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.256971:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36400/0xa1d8aa9164aa4156 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268ac expref: 10 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.256982:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f300) 00010000:00010000:0.0:1788940932.256985:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940932.256990:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36400, rc 0) 00000100:00100000:0.0:1788940932.257074:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+10:14450:x1875840036096256:12345-192.168.202.17@tcp:101:lctl.0 Request processed in 516us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940932.257083:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 20 00000100:00100000:2.0:1788940932.300461:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940932.300747:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036096384 00000100:00100000:0.0:1788940932.300763:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036096384 00000100:00100000:0.0:1788940932.300858:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 21 00000100:00100000:0.0:1788940932.300872:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+5:14451:x1875840036096384:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940932.300901:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940932.300958:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa415d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2268b3 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.301046:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa4164 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.301063:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa4164 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.301076:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa4164 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940932.301135:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788940932.301139:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788940932.301163:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa4164 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.301245:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa415d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268b3 expref: 7 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.301268:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36e00/0xa1d8aa9164aa4164 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268b3 expref: 6 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.301278:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f300) 00010000:00010000:0.0:1788940932.301281:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940932.301286:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36e00, rc 0) 00000100:00100000:0.0:1788940932.301727:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:14451:x1875840036096384:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 855us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940932.301735:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 21 00000100:00100000:2.0:1788940932.307242:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.307380:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036096512 00000100:00100000:1.0:1788940932.307395:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036096512 00000100:00100000:1.0:1788940932.307472:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 22 00000100:00100000:1.0:1788940932.307485:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:14451:x1875840036096512:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:1.0:1788940932.307515:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940932.307544:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa416b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2268ba expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.307633:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4172 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.307650:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4172 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.307686:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4172 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.307705:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4179 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.307712:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4179 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.307719:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4179 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.307840:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6800/0xa1d8aa9164aa4180 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.307860:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6800/0xa1d8aa9164aa4180 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.307868:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6800/0xa1d8aa9164aa4180 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940932.307920:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940932.307925:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940932.307951:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6800/0xa1d8aa9164aa4180 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.307966:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4172 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.307973:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4172 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.307996:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4172 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.308003:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940932.308008:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4172 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.308019:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4172 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.308032:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f300) 00010000:00010000:1.0:1788940932.308036:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940932.308042:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4172 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.308049:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4172 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.308065:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4179 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.308071:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4179 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.308077:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4179 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.308083:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940932.308086:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4179 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.308102:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4179 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.308111:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f41129a4600) 00010000:00010000:1.0:1788940932.308113:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940932.308116:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4179 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.308123:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa4179 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.308158:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa416b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268ba expref: 8 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.308174:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6800/0xa1d8aa9164aa4180 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268ba expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.308182:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f41129a4900) 00010000:00010000:1.0:1788940932.308245:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788940932.308249:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6800, rc 0) 00000100:00100000:1.0:1788940932.308341:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+7:14451:x1875840036096512:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 859us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940932.308350:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 22 00000100:00100000:3.0:1788940932.317679:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940932.317887:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036096768 00000100:00100000:0.0:1788940932.317931:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036096768 00000100:00100000:0.0:1788940932.318021:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 23 00000100:00100000:0.0:1788940932.318034:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+7:14451:x1875840036096768:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940932.318068:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940932.318099:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4187 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2268c1 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940932.318298:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788940932.318588:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4187 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268c1 expref: 9 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.318606:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f300) 00010000:00010000:0.0:1788940932.318610:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940932.318616:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4187 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268c1 expref: 9 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.318633:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37800, rc 0) 00000100:00100000:0.0:1788940932.318714:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+8:14451:x1875840036096768:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 682us (1053us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788940932.318722:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 23 00000100:00100000:2.0:1788940932.324182:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940932.324510:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036097024 00000100:00100000:0.0:1788940932.324525:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036097024 00000100:00100000:0.0:1788940932.324615:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 24 00000100:00100000:0.0:1788940932.324628:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+8:14451:x1875840036097024:12345-192.168.202.17@tcp:36:lfs.0 00010000:00010000:0.0:1788940932.324707:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940932.324746:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6800/0xa1d8aa9164aa4180 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268ba expref: 8 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.324796:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f41129a4900) 00010000:00010000:0.0:1788940932.324812:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788940932.324846:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa4195 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.324862:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa4195 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.324874:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa4195 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940932.325267:0:14429:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004860e145 reply state 0000000089035e11 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa4195 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940932.325280:0:14429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788940932.325290:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788940932.325417:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+9:14451:x1875840036097024:12345-192.168.202.17@tcp:36:lfs.0 Request processed in 790us (1249us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788940932.325425:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 24 00000100:00100000:2.0:1788940932.329038:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.329174:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036097280 00000100:00100000:1.0:1788940932.329248:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036097280 00000100:00100000:1.0:1788940932.329324:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 2 00000100:00100000:1.0:1788940932.329348:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+9:14451:x1875840036097280:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:1.0:1788940932.329844:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+10:14451:x1875840036097280:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 497us (821us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788940932.329853:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 2 00010000:00010000:3.0:1788940932.333815:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa4195 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940932.333834:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa4195 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940932.333842:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa4195 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940932.333848:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940932.333853:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa4195 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940932.333861:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa4195 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940932.333895:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f410ad9f400) 00010000:00010000:3.0:1788940932.333899:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788940932.333913:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa4195 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940932.333920:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa4195 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940932.335625:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.335791:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036097536 00000100:00100000:1.0:1788940932.335808:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036097536 00000100:00100000:1.0:1788940932.336051:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 25 00000100:00100000:1.0:1788940932.336065:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+9:14451:x1875840036097536:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:1.0:1788940932.336100:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940932.336138:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa419c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2268c8 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336281:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336300:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336313:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336338:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336346:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336353:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940932.336496:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788940932.336646:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336655:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336660:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336666:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940932.336671:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336680:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336695:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f300) 00010000:00010000:1.0:1788940932.336698:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940932.336703:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336709:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336724:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336729:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336735:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336766:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940932.336769:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336775:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336783:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f41129a4600) 00010000:00010000:1.0:1788940932.336786:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940932.336788:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336795:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336842:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa419c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268c8 expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336863:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f300) 00010000:00010000:1.0:1788940932.336865:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940932.336869:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa419c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268c8 expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.336879:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7200, rc 0) 00000100:00100000:1.0:1788940932.336988:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+10:14451:x1875840036097536:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 925us (1370us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788940932.336997:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 25 00000100:00100000:1.0:1788940932.344825:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940932.344996:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036097664 00000100:00100000:2.0:1788940932.345012:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036097664 00000100:00100000:2.0:1788940932.345082:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 26 00000100:00100000:2.0:1788940932.345093:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+10:14451:x1875840036097664:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:2.0:1788940932.345120:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940932.345145:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218c000/0xa1d8aa9164aa41b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2268cf expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940932.345274:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218ce00/0xa1d8aa9164aa41bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940932.345289:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218ce00/0xa1d8aa9164aa41bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940932.345303:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218ce00/0xa1d8aa9164aa41bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788940932.345326:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788940932.345330:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788940932.345349:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218ce00/0xa1d8aa9164aa41bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940932.345377:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218c000/0xa1d8aa9164aa41b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268cf expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940932.345395:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218ce00/0xa1d8aa9164aa41bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268cf expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940932.345404:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4111ce7d00) 00010000:00010000:2.0:1788940932.345406:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788940932.345411:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f400218ce00, rc 0) 00000100:00100000:2.0:1788940932.345474:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+11:14451:x1875840036097664:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 383us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940932.345482:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 26 00000100:00100000:2.0:1788940932.351549:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.351623:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036097792 00000100:00100000:1.0:1788940932.351643:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036097792 00000100:00100000:1.0:1788940932.351701:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 3 00000100:00100000:1.0:1788940932.351711:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+11:14451:x1875840036097792:12345-192.168.202.17@tcp:37:lfs.0 00000100:00100000:1.0:1788940932.361120:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+11:14451:x1875840036097792:12345-192.168.202.17@tcp:37:lfs.0 Request processed in 9395us (9568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940932.361141:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 3 00000100:00100000:2.0:1788940932.368169:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.375359:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036098048 00000100:00100000:1.0:1788940932.375378:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036098048 00000100:00100000:1.0:1788940932.375449:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 4 00000100:00100000:1.0:1788940932.375460:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5f5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+11:14451:x1875840036098048:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:1.0:1788940932.377635:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5f5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+12:14451:x1875840036098048:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 2151us (9450us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788940932.377650:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 4 00000100:00100000:2.0:1788940932.440551:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.441000:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036098176 00000100:00100000:1.0:1788940932.441010:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036098176 00000100:00100000:1.0:1788940932.441089:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 27 00000100:00100000:1.0:1788940932.441097:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+10:14457:x1875840036098176:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:1.0:1788940932.441116:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940932.441134:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa41c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2268d6 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441238:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441258:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441284:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441294:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441299:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441303:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441383:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6800/0xa1d8aa9164aa41db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441388:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6800/0xa1d8aa9164aa41db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441392:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6800/0xa1d8aa9164aa41db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940932.441414:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788940932.441416:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940932.441443:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6800/0xa1d8aa9164aa41db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441453:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441457:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441468:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441473:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940932.441476:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441480:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441489:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f300) 00010000:00010000:1.0:1788940932.441491:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940932.441495:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441499:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa41cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441509:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441512:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441516:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441519:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940932.441520:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441529:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441534:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f41129a4600) 00010000:00010000:1.0:1788940932.441535:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940932.441537:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441540:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa41d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441563:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7200/0xa1d8aa9164aa41c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268d6 expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441676:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6800/0xa1d8aa9164aa41db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268d6 expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.441684:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4111ce7d00) 00010000:00010000:1.0:1788940932.441687:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788940932.441689:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6800, rc 0) 00000100:00100000:1.0:1788940932.441757:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+11:14457:x1875840036098176:12345-192.168.202.17@tcp:101:bash.0 Request processed in 660us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940932.441762:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 27 00000100:00100000:2.0:1788940932.451743:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940932.451860:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036098432 00000100:00100000:0.0:1788940932.451871:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036098432 00000100:00100000:0.0:1788940932.451945:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 28 00000100:00100000:0.0:1788940932.451956:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+11:14457:x1875840036098432:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:0.0:1788940932.451975:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940932.451995:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa41e2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2268dd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.452114:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.452140:0:14429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218ce00/0xa1d8aa9164aa41bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268cf expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.452150:0:14429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.452254:0:14429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218ce00/0xa1d8aa9164aa41bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268cf expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.452269:0:14429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218ce00/0xa1d8aa9164aa41bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268cf expref: 11 pid: 14430 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940932.452285:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134691f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1875840068597888:192.168.202.17@tcp:104: 00000100:00100000:0.0:1788940932.452379:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108e9c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788940932.457238:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134691f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1875840068597888:192.168.202.17@tcp:104: 00010000:00010000:0.0:1788940932.457286:0:14429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940932.460342:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.460484:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036098560 00000100:00100000:1.0:1788940932.460495:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036098560 00010000:00010000:1.0:1788940932.460535:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218ce00/0xa1d8aa9164aa41bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268cf expref: 12 pid: 14430 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940932.460643:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:1.0:1788940932.460654:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+12:2358:x1875840036098560:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940932.460670:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940932.460677:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218ce00/0xa1d8aa9164aa41bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268cf expref: 12 pid: 14430 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.460690:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218ce00/0xa1d8aa9164aa41bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268cf expref: 12 pid: 14430 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.460717:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f400218ce00/0xa1d8aa9164aa41bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268cf expref: 12 pid: 14430 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.460739:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4111ce7d00) 00010000:00010000:1.0:1788940932.460745:0:14415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.460755:0:14415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.460763:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.460788:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940932.460847:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+11:2358:x1875840036098560:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 195us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940932.460855:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 10 00010000:00010000:0.0:1788940932.461105:0:14429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.461115:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.461142:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa41f0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.461153:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa41f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.461169:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa41f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.464130:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa41f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.464152:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa41f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.464166:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa41f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940932.464180:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788940932.464434:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.464448:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.464455:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.464461:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940932.464529:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.464539:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.464553:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4111ce7d00) 00010000:00010000:0.0:1788940932.464556:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788940932.464639:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.464646:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa41e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788940932.464661:0:14429:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b91c163 reply state 0000000073e59cbc transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa41f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940932.464670:0:14429:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788940932.464711:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa41e2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268dd expref: 14 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.464724:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa41f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268dd expref: 13 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.464732:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:0.0:1788940932.464735:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788940932.464737:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b36000, rc 0) 00000100:00100000:0.0:1788940932.464816:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+14:14457:x1875840036098432:12345-192.168.202.17@tcp:101:bash.0 Request processed in 12861us (13082us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788940932.464826:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 28 00010000:00010000:1.0:1788940932.468990:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa41f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.469024:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa41f0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.469033:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa41f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.469040:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940932.469045:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa41f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.469054:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa41f0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.469070:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f410ad9fe00) 00010000:00010000:1.0:1788940932.469073:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940932.469090:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa41f0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.469096:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37c00/0xa1d8aa9164aa41f0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940932.494024:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.494551:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036098688 00000100:00100000:1.0:1788940932.494563:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036098688 00000100:00100000:1.0:1788940932.494730:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 29 00000100:00100000:1.0:1788940932.494741:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+13:14457:x1875840036098688:12345-192.168.202.17@tcp:101:bash.0 00010000:00010000:1.0:1788940932.494766:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940932.494788:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4205 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2268e4 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.494916:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa420c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.494932:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa420c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.494945:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa420c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940932.494990:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788940932.494994:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940932.495013:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa420c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.495024:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa420c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.495051:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4205 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268e4 expref: 15 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.495070:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa420c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268e4 expref: 14 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.495091:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:1.0:1788940932.495094:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940932.495098:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7a00, rc 0) 00000100:00100000:1.0:1788940932.495168:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+14:14457:x1875840036098688:12345-192.168.202.17@tcp:101:bash.0 Request processed in 429us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940932.495175:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 29 00000100:00100000:2.0:1788940932.500154:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.500302:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036098944 00000100:00100000:1.0:1788940932.500313:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036098944 00000100:00100000:1.0:1788940932.500370:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:1.0:1788940932.500381:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+14:14457:x1875840036098944:12345-192.168.202.17@tcp:35:bash.0 00000100:00100000:1.0:1788940932.500958:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+15:14457:x1875840036098944:12345-192.168.202.17@tcp:35:bash.0 Request processed in 575us (815us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788940932.500967:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:3.0:1788940932.610844:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940932.610960:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036099200 00000100:00100000:0.0:1788940932.610974:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036099200 00000100:00100000:0.0:1788940932.611051:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 30 00000100:00100000:0.0:1788940932.611063:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+15:14467:x1875840036099200:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:0.0:1788940932.611093:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940932.611117:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2268eb expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940932.611315:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788940932.611439:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4213 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268eb expref: 17 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.611454:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f410ad9f300) 00010000:00010000:0.0:1788940932.611457:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940932.611463:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268eb expref: 17 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.611477:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37800, rc 0) 00000100:00100000:0.0:1788940932.611551:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+16:14467:x1875840036099200:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 489us (717us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788940932.611559:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 30 00000100:00100000:2.0:1788940932.615660:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.615776:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036099456 00000100:00100000:1.0:1788940932.615787:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036099456 00000100:00100000:1.0:1788940932.615871:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00100000:1.0:1788940932.615882:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+16:14467:x1875840036099456:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:1.0:1788940932.616158:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+17:14467:x1875840036099456:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 276us (508us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788940932.616165:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00100000:2.0:1788940932.616550:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940932.616568:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068598016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940932.616622:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788940932.616724:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940932.617102:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068598016 00000100:00100000:0.0:1788940932.617109:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068598016 00000100:00100000:0.0:1788940932.617167:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788940932.617177:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068598016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940932.617235:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788940932.617295:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068598016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940932.617302:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788940932.617611:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940932.617666:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068598016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940932.670485:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.671069:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036099712 00000100:00100000:1.0:1788940932.671080:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036099712 00000100:00100000:1.0:1788940932.671232:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 31 00000100:00100000:1.0:1788940932.671244:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+17:14470:x1875840036099712:12345-192.168.202.17@tcp:101:lfs.0 00010000:00010000:1.0:1788940932.671280:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940932.671302:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4221 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2268f2 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.671410:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa4228 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.671425:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa4228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.671453:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa4228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940932.671466:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788940932.671604:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4221 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268f2 expref: 20 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.671625:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa4228 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268f2 expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940932.671634:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:1.0:1788940932.671637:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940932.671641:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6400, rc 0) 00000100:00100000:1.0:1788940932.671709:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+19:14470:x1875840036099712:12345-192.168.202.17@tcp:101:lfs.0 Request processed in 468us (1236us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788940932.671716:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 31 00000100:00100000:2.0:1788940932.675951:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940932.676013:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940932.676101:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036099968 00000100:00100000:3.0:1788940932.676112:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036099968 00000100:00100000:3.0:1788940932.676178:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:3.0:1788940932.676215:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f873100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+19:2360:x1875840036099968:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788940932.676231:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788940932.676254:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa4228 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268f2 expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940932.676284:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:3.0:1788940932.676289:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788940932.676345:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f873100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+18:2360:x1875840036099968:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 158us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940932.676353:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:0.0:1788940932.676513:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036099840 00000100:00100000:0.0:1788940932.676518:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036099840 00000100:00100000:0.0:1788940932.676557:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 32 00000100:00100000:0.0:1788940932.676565:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+18:14470:x1875840036099840:12345-192.168.202.17@tcp:54:lfs.0 00010000:00010000:0.0:1788940932.676635:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4236 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.676649:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.676661:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.676687:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.676695:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4236 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.676702:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4236 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.676708:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37800 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:0.0:1788940932.676712:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4236 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.676720:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4236 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.676728:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:0.0:1788940932.676731:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788940932.676734:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4236 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940932.676740:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa4236 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940932.676787:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+18:14470:x1875840036099840:12345-192.168.202.17@tcp:54:lfs.0 Request processed in 223us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940932.676794:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 32 00000100:00100000:2.0:1788940932.680243:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940932.680385:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036100224 00000100:00100000:1.0:1788940932.680398:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036100224 00000100:00100000:1.0:1788940932.680454:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:1.0:1788940932.680467:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+18:14470:x1875840036100224:12345-192.168.202.17@tcp:35:lfs.0 00000100:00100000:1.0:1788940932.680729:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+19:14470:x1875840036100224:12345-192.168.202.17@tcp:35:lfs.0 Request processed in 264us (495us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788940932.680737:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:1.0:1788940933.103844:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940933.104051:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036100480 00000100:00100000:0.0:1788940933.104063:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036100480 00000100:00100000:0.0:1788940933.104155:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 33 00000100:00100000:0.0:1788940933.104167:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+19:14501:x1875840036100480:12345-192.168.202.17@tcp:101:cat.0 00010000:00010000:0.0:1788940933.104219:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940933.104241:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa423d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c2268f9 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.104341:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa4244 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.104356:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa4244 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.104370:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa4244 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788940933.104382:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788940933.104529:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa423d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268f9 expref: 22 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.104550:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa4244 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268f9 expref: 21 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.104559:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:0.0:1788940933.104584:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788940933.104589:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37a00, rc 0) 00000100:00100000:0.0:1788940933.104657:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+21:14501:x1875840036100480:12345-192.168.202.17@tcp:101:cat.0 Request processed in 493us (825us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788940933.104664:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 33 00000100:00080000:2.0:1788940933.104910:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940933.111621:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940933.111935:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036100608 00000100:00100000:1.0:1788940933.111947:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036100608 00000100:00100000:1.0:1788940933.112040:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 1 00000100:00100000:1.0:1788940933.112052:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+21:2359:x1875840036100608:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788940933.112068:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940933.112102:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37a00/0xa1d8aa9164aa4244 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268f9 expref: 21 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.112124:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:1.0:1788940933.112130:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940933.112225:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+20:2359:x1875840036100608:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 175us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940933.112232:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 1 00000100:00100000:2.0:1788940933.112424:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940933.112745:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036100864 00000100:00100000:1.0:1788940933.112750:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036100864 00000100:00100000:1.0:1788940933.112782:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 8 00000100:00100000:1.0:1788940933.112790:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+20:14501:x1875840036100864:12345-192.168.202.17@tcp:35:cat.0 00000100:00100000:1.0:1788940933.113130:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+21:14501:x1875840036100864:12345-192.168.202.17@tcp:35:cat.0 Request processed in 340us (706us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788940933.113138:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 8 00000100:00100000:3.0:1788940933.198083:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940933.198442:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036101120 00000100:00100000:1.0:1788940933.198454:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036101120 00000100:00100000:1.0:1788940933.198519:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 34 00000100:00100000:1.0:1788940933.198530:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+21:14507:x1875840036101120:12345-192.168.202.17@tcp:101:dd.0 00010000:00010000:1.0:1788940933.198556:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940933.198576:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4252 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226900 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.198693:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa4259 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.198707:0:14429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa41f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268dd expref: 22 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.198866:0:14429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa420c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268e4 expref: 22 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.198875:0:14429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa4259 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.198923:0:14429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa420c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268e4 expref: 22 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.198936:0:14429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa420c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268e4 expref: 22 pid: 14431 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940933.198949:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1875840068598144:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940933.199037:0:14429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa41f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268dd expref: 22 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.199046:0:14429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa41f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268dd expref: 22 pid: 14429 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940933.199055:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1875840068598272:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940933.199084:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003400300 going to sleep for 11 seconds 00000100:00100000:2.0:1788940933.212393:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940933.212443:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940933.212569:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036101248 00000100:00100000:0.0:1788940933.212580:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036101248 00010000:00010000:0.0:1788940933.212622:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa420c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268e4 expref: 23 pid: 14431 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940933.212663:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036101376 00000100:00100000:0.0:1788940933.212667:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036101376 00010000:00010000:0.0:1788940933.212682:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa41f7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268dd expref: 24 pid: 14429 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940933.212698:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:0.0:1788940933.212707:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f585c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+24:2358:x1875840036101248:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940933.212733:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940933.212741:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa420c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268e4 expref: 24 pid: 14431 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.212753:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa420c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268e4 expref: 24 pid: 14431 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.212775:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:0.0:1788940933.212780:0:14415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa4259 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.212788:0:14415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa4259 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.212818:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940933.212871:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f585c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+24:2358:x1875840036101248:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 164us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940933.212879:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:0.0:1788940933.212943:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 12 00000100:00100000:0.0:1788940933.212950:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+23:2359:x1875840036101376:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940933.212958:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940933.212963:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa41f7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268dd expref: 23 pid: 14429 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.212973:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa41f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268dd expref: 23 pid: 14429 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.212984:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:0.0:1788940933.212988:0:14415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa4259 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.212995:0:14415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa4259 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.213002:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa4259 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.213020:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940933.213039:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+23:2359:x1875840036101376:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 90us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940933.213046:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 12 00010000:00010000:1.0:1788940933.214094:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa420c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268e4 expref: 22 pid: 14431 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940933.214115:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1875840068598144:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940933.214128:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa41f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c2268dd expref: 21 pid: 14429 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940933.214292:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1875840068598272:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940933.214316:0:14429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa4259 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.214327:0:14429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa4259 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.214334:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa4259 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940933.214355:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788940933.214619:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4252 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226900 expref: 22 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.214635:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6200/0xa1d8aa9164aa4259 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226900 expref: 21 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.214644:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:1.0:1788940933.214646:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788940933.214650:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6200, rc 0) 00000100:00100000:1.0:1788940933.214988:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+21:14507:x1875840036101120:12345-192.168.202.17@tcp:101:dd.0 Request processed in 16458us (16913us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788940933.214996:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 34 00000100:00100000:2.0:1788940933.229760:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940933.230237:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036101632 00000100:00100000:1.0:1788940933.230249:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036101632 00000100:00100000:1.0:1788940933.230309:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 35 00000100:00100000:1.0:1788940933.230320:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+21:14507:x1875840036101632:12345-192.168.202.17@tcp:36:dd.0 00010000:00010000:1.0:1788940933.230605:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa4267 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.230621:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa4267 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.230632:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa4267 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940933.230682:0:14430:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788940933.230708:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007f3547f reply state 00000000e9deb296 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa4267 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940933.230718:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940933.230822:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+24:14507:x1875840036101632:12345-192.168.202.17@tcp:36:dd.0 Request processed in 502us (1071us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788940933.230828:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 35 00000020:00080000:1.0:1788940933.230833:0:14430:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788940933.239553:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa4267 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940933.239572:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa4267 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940933.239580:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa4267 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940933.239585:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7a00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940933.239603:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa4267 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940933.239612:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa4267 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940933.239629:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:3.0:1788940933.239633:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940933.239638:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa4267 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940933.239644:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa4267 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940933.241243:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940933.241336:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036101760 00000100:00100000:1.0:1788940933.241346:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036101760 00000100:00100000:1.0:1788940933.241399:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 36 00000100:00100000:1.0:1788940933.241410:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+23:14507:x1875840036101760:12345-192.168.202.17@tcp:101:dd.0 00010000:00010000:1.0:1788940933.241458:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940933.241479:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa426e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226907 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.241540:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa426e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226907 expref: 24 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.241555:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa426e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226907 expref: 24 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940933.241575:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:1.0:1788940933.241579:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788940933.241582:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7c00, rc 0) 00000100:00100000:1.0:1788940933.241636:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+24:14507:x1875840036101760:12345-192.168.202.17@tcp:101:dd.0 Request processed in 228us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940933.241642:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 36 00000100:00100000:2.0:1788940933.278679:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940933.278836:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036102016 00000100:00100000:0.0:1788940933.278847:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036102016 00000100:00100000:0.0:1788940933.279032:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 2 00000100:00100000:0.0:1788940933.279044:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f872d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+24:14507:x1875840036102016:12345-192.168.202.17@tcp:103:dd.0 00010000:00010000:0.0:1788940933.279060:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940933.279085:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa426e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226907 expref: 24 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.279105:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:0.0:1788940933.279110:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940933.279179:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f872d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+23:14507:x1875840036102016:12345-192.168.202.17@tcp:103:dd.0 Request processed in 137us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940933.279551:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 2 00000100:00100000:3.0:1788940933.286010:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940933.287000:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036102144 00000100:00100000:0.0:1788940933.287015:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036102144 00000100:00100000:0.0:1788940933.287129:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 37 00000100:00100000:0.0:1788940933.287153:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+23:14507:x1875840036102144:12345-192.168.202.17@tcp:58:dd.0 00010000:00010000:0.0:1788940933.287320:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4275 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.287340:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4275 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.287353:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4275 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788940933.288150:0:14431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788940933.289996:0:14431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788940933.290121:0:14431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788940933.290919:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+23:14507:x1875840036102144:12345-192.168.202.17@tcp:58:dd.0 Request processed in 3771us (4910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940933.290931:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 37 00000100:00100000:2.0:1788940933.300274:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940933.300622:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036102272 00000100:00100000:0.0:1788940933.300633:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036102272 00000100:00100000:0.0:1788940933.300696:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 38 00000100:00100000:0.0:1788940933.300706:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+23:14507:x1875840036102272:12345-192.168.202.17@tcp:101:dd.0 00010000:00010000:0.0:1788940933.300726:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788940933.300749:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa427c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22690e expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.300808:0:14430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4275 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.300820:0:14430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa427c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22690e expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.300840:0:14430:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4275 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.300854:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa427c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22690e expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.300867:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:0.0:1788940933.300871:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788940933.300874:0:14430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa427c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22690e expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940933.300882:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4113b37800, rc 0) 00000100:00100000:0.0:1788940933.300969:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+24:14507:x1875840036102272:12345-192.168.202.17@tcp:101:dd.0 Request processed in 264us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940933.300976:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 38 00010000:00010000:1.0:1788940933.640941:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788940933.700147:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:3.0:1788940933.700164:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:3.0:1788940933.700177:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:3.0:1788940933.700221:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:1.0:1788940934.088493:0:14463:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788940934.088504:0:14463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940934.088550:0:14463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788940934.088559:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788940934.088687:0:14463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14463:1875840068598400:192.168.202.17@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788940934.088799:0:14463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4139f7c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940934.094761:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.095253:0:14463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e4e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14463:1875840068598400:192.168.202.17@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788940934.095859:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036102400 00000100:00100000:3.0:1788940934.095869:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036102400 00000100:00100000:3.0:1788940934.095957:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:3.0:1788940934.095968:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413f871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+11:14508:x1875840036102400:12345-192.168.202.17@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788940934.096068:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413f871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+11:14508:x1875840036102400:12345-192.168.202.17@tcp:900:lhsmtool_posix.0 Request processed in 102us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940934.096076:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:2.0:1788940934.106532:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940934.106659:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036102528 00000100:00100000:0.0:1788940934.106669:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036102528 00000100:00100000:0.0:1788940934.106725:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 39 00000100:00100000:0.0:1788940934.106735:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+11:14508:x1875840036102528:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788940934.106769:0:14431:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788940934.106871:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+11:14508:x1875840036102528:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 Request processed in 138us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940934.106877:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 39 00000100:00100000:0.0:1788940934.112214:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.113087:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036102656 00000100:00100000:1.0:1788940934.113098:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036102656 00000100:00100000:1.0:1788940934.113170:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 40 00000100:00100000:1.0:1788940934.113218:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+11:14508:x1875840036102656:12345-192.168.202.17@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788940934.113403:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa4283 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113418:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa4283 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113428:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa4283 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113438:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa428a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113442:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa428a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113446:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa428a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113523:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4291 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113532:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4291 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113538:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4291 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940934.113576:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788940934.113580:0:14429:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940934.113590:0:14429:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4291 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113606:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa4283 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113610:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa4283 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113615:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa4283 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113619:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940934.113622:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa4283 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113626:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa4283 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113634:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9f900) 00010000:00010000:1.0:1788940934.113636:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940934.113640:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa4283 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113643:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa4283 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113652:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa428a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113656:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa428a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113659:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa428a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113665:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940934.113667:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa428a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113671:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa428a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113675:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8f41129a4d00) 00010000:00010000:1.0:1788940934.113676:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940934.113678:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa428a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113681:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa428a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113690:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4291 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113694:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4291 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113748:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4291 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113753:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940934.113756:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4291 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113761:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4291 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113779:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:1.0:1788940934.113782:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940934.113785:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4291 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.113791:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa4291 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940934.113875:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+11:14508:x1875840036102656:12345-192.168.202.17@tcp:34:lhsmtool_posix.0 Request processed in 660us (1700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940934.113881:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 40 00000100:00100000:2.0:1788940934.117563:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.117672:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036102912 00000100:00100000:1.0:1788940934.117684:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036102912 00000100:00100000:1.0:1788940934.117746:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 41 00000100:00100000:1.0:1788940934.117757:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+11:14508:x1875840036102912:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940934.117780:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940934.117801:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa4298 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226915 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.117926:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa429f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.117940:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa429f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.117950:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa429f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940934.117959:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788940934.118228:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa429f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.118237:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa429f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.118394:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa429f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.118399:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940934.118402:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa429f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.118407:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa429f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.118416:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:1.0:1788940934.118418:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788940934.118421:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa429f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.118425:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa429f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.118514:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa4298 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226915 expref: 13 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.118524:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f410ad9f900) 00010000:00010000:1.0:1788940934.118527:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788940934.118530:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa4298 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226915 expref: 13 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.118553:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7a00, rc 0) 00000100:00100000:1.0:1788940934.118688:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+12:14508:x1875840036102912:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 932us (1133us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788940934.118696:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 41 00000100:00100000:2.0:1788940934.123649:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.126996:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036103040 00000100:00100000:1.0:1788940934.127013:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036103040 00000100:00100000:1.0:1788940934.127087:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 42 00000100:00100000:1.0:1788940934.127098:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+12:14508:x1875840036103040:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788940934.127135:0:14429:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788940934.127276:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+12:14508:x1875840036103040:12345-192.168.202.17@tcp:53:lhsmtool_posix.0 Request processed in 179us (3637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940934.127284:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 42 00000100:00100000:0.0:1788940934.131966:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.132263:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036103296 00000100:00100000:1.0:1788940934.132274:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036103296 00000100:00100000:1.0:1788940934.132334:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 43 00000100:00100000:1.0:1788940934.132344:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+12:14508:x1875840036103296:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940934.132368:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940934.132393:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa42ad lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22691c expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788940934.134033:0:14430:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1788940934.134044:0:14430:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1788940934.134093:0:14430:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788940934.135839:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa42b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.135876:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa42b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.135900:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa42b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.135976:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa42ad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22691c expref: 15 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.135996:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa42b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22691c expref: 14 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.136005:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f41129a4d00) 00010000:00010000:1.0:1788940934.136008:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788940934.136011:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6400, rc 0) 00000100:00100000:1.0:1788940934.136166:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+14:14508:x1875840036103296:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 3822us (4210us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788940934.136226:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 43 00000100:00100000:2.0:1788940934.142543:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.143136:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036103552 00000100:00100000:1.0:1788940934.143149:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036103552 00000100:00100000:1.0:1788940934.143477:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 44 00000100:00100000:1.0:1788940934.143489:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+14:14508:x1875840036103552:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788940934.143547:0:14429:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940934.143586:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6400/0xa1d8aa9164aa42b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22691c expref: 14 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.143776:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f41129a4d00) 00010000:00010000:1.0:1788940934.143803:0:14429:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940934.143829:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42c2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.143851:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.143863:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.143876:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa42c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9c662318 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.143884:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa42c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9c662318 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.143901:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa42c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9c662318 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.144105:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42c2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.144114:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42c2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.144121:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.144127:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7c00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940934.144132:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42c2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.144139:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42c2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.144156:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f4111ce7d00) 00010000:00010000:1.0:1788940934.144158:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940934.144163:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42c2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.144180:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42c2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.144221:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa42c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9c662318 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.144228:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa42c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9c662318 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.144234:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa42c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9c662318 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.144247:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940934.144251:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa42c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9c662318 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.144257:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa42c9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9c662318 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.144265:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9c662318 (ffff8f41129a4100) 00010000:00010000:1.0:1788940934.144268:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788940934.144271:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa42c9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9c662318 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.144277:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa42c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9c662318 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940934.144375:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+13:14508:x1875840036103552:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 887us (1842us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788940934.144384:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 44 00000100:00100000:2.0:1788940934.148016:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940934.150210:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036103680 00000100:00100000:0.0:1788940934.150227:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036103680 00000100:00100000:1.0:1788940934.150567:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 45 00000100:00100000:1.0:1788940934.150584:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+13:14508:x1875840036103680:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940934.150618:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940934.150649:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa42d0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226923 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.150695:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa42d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.150712:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa42d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.150726:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa42d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.150860:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7a00/0xa1d8aa9164aa42d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226923 expref: 15 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.150880:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6c00/0xa1d8aa9164aa42d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226923 expref: 14 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.150899:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f41129a4600) 00010000:00010000:1.0:1788940934.150902:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788940934.150906:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc6c00, rc 0) 00000100:00100000:1.0:1788940934.150987:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+14:14508:x1875840036103680:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 407us (2980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940934.150994:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 45 00000100:00100000:2.0:1788940934.153769:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068598656:0@lo:400:kworker.0 00000100:00100000:2.0:1788940934.153859:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940934.153948:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068599168:0@lo:400:kworker.0 00000100:00100000:2.0:1788940934.153977:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940934.154003:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788940934.154010:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:340eef01-7b53-49af-9aa3-2abb708ce8bb:3304:1875840068598528:0@lo:400:kworker.0 00000100:00100000:2.0:1788940934.154038:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940934.154068:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068599040:0@lo:400:kworker.0 00000100:00100000:2.0:1788940934.154091:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940934.154113:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068598784:0@lo:400:kworker.0 00000100:00100000:2.0:1788940934.154136:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940934.154153:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940934.154158:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068598912:0@lo:400:kworker.0 00000100:00100000:2.0:1788940934.154216:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940934.154255:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068598656 00000100:00100000:2.0:1788940934.154263:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068598656 00000100:00100000:2.0:1788940934.154318:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068598784 00000100:00100000:2.0:1788940934.154321:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068598784 00000100:00100000:2.0:1788940934.154348:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940934.154356:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068598656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940934.154434:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875840068598656:12345-0@lo:400:kworker.0 Request processed in 79us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940934.154442:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788940934.154474:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788940934.154482:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068598784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940934.154515:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1875840068598784:12345-0@lo:400:kworker.0 Request processed in 35us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940934.154521:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788940934.154543:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788940934.154547:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940934.154580:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3301:1875840068598784:0@lo:400:kworker.0 00000100:00100000:2.0:1788940934.154604:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3304:1875840068598656:0@lo:400:kworker.0 00000100:00100000:3.0:1788940934.154911:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068599168 00000100:00100000:3.0:1788940934.154916:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068599168 00000100:00100000:3.0:1788940934.154949:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068599040 00000100:00100000:3.0:1788940934.154952:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068599040 00000100:00100000:3.0:1788940934.154971:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068598912 00000100:00100000:3.0:1788940934.154974:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068598912 00000100:00100000:3.0:1788940934.154985:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788940934.154991:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068599168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940934.155031:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875840068599168:12345-0@lo:400:kworker.0 Request processed in 40us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940934.155037:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788940934.155049:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788940934.155055:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068599040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940934.155085:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875840068599040:12345-0@lo:400:kworker.0 Request processed in 30us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940934.155103:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788940934.155116:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788940934.155122:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068598912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940934.155151:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875840068598912:12345-0@lo:400:kworker.0 Request processed in 29us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940934.155156:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788940934.155225:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068598528 00000100:00100000:3.0:1788940934.155230:0:14422:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068598528 00000100:00100000:3.0:1788940934.155259:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788940934.155265:0:14422:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3304:x1875840068598528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940934.155297:0:14422:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f586850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:340eef01-7b53-49af-9aa3-2abb708ce8bb+19:3304:x1875840068598528:12345-0@lo:400:kworker.0 Request processed in 31us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940934.155303:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1788940934.155928:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788940934.155960:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875840068598912:0@lo:400:kworker.0 00000100:00100000:2.0:1788940934.155988:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:340eef01-7b53-49af-9aa3-2abb708ce8bb:3304:1875840068598528:0@lo:400:kworker.0 00000100:00100000:2.0:1788940934.155998:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3304:1875840068599040:0@lo:400:kworker.0 00000100:00100000:2.0:1788940934.156007:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3304:1875840068599168:0@lo:400:kworker.0 00000100:00100000:0.0:1788940934.160219:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788940934.160254:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068599296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940934.160328:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940934.160875:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068599296 00000100:00100000:1.0:1788940934.160884:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068599296 00000100:00100000:1.0:1788940934.160942:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788940934.160952:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068599296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940934.160989:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940934.161038:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068599296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940934.161046:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940934.163180:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068599296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940934.170570:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940934.171085:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036103936 00000100:00100000:3.0:1788940934.171095:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036103936 00000100:00100000:3.0:1788940934.171162:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 46 00000100:00100000:3.0:1788940934.171211:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+14:14508:x1875840036103936:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788940934.171300:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43e00/0xa1d8aa9164aa42de lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.171317:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43e00/0xa1d8aa9164aa42de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.171330:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43e00/0xa1d8aa9164aa42de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788940934.171983:0:14431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1788940934.171994:0:14431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 575475806506ns, next at 576475804124ns, rc = 0 00000004:00010000:3.0:1788940934.172085:0:14431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f981b0dc reply state 00000000fa301084 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43e00/0xa1d8aa9164aa42de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940934.172096:0:14431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788940934.172231:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+16:14508:x1875840036103936:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 1043us (1670us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788940934.172239:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 46 00000100:00100000:0.0:1788940934.177296:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940934.177767:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036104064 00000100:00100000:3.0:1788940934.177780:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036104064 00000100:00100000:3.0:1788940934.177838:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 47 00000100:00100000:3.0:1788940934.177847:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+16:14508:x1875840036104064:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940934.177870:0:14429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940934.177901:0:14429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa42e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22692a expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.177963:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa42e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22692a expref: 17 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.178001:0:14429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa42e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22692a expref: 17 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.178022:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f41129a4600) 00010000:00010000:3.0:1788940934.178025:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940934.178028:0:14429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4140f43a00, rc 0) 00000100:00100000:3.0:1788940934.178089:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+17:14508:x1875840036104064:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 243us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940934.178096:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 47 00010000:00010000:1.0:1788940934.180500:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43e00/0xa1d8aa9164aa42de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.180515:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43e00/0xa1d8aa9164aa42de lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.180523:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43e00/0xa1d8aa9164aa42de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.180529:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f43e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:1.0:1788940934.180534:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43e00/0xa1d8aa9164aa42de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.180543:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43e00/0xa1d8aa9164aa42de lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.180561:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f41129a4600) 00010000:00010000:1.0:1788940934.180564:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788940934.180570:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43e00/0xa1d8aa9164aa42de lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.180593:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43e00/0xa1d8aa9164aa42de lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940934.182999:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940934.183161:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036104192 00000100:00100000:2.0:1788940934.183172:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036104192 00000100:00100000:2.0:1788940934.183288:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00100000:2.0:1788940934.183299:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2358:x1875840036104192:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788940934.183560:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940934.184027:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:2358:x1875840036104192:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 Request processed in 727us (1036us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788940934.184055:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00100000:1.0:1788940934.188794:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940934.188908:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036104448 00000100:00100000:2.0:1788940934.188918:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036104448 00000100:00100000:2.0:1788940934.189011:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00100000:2.0:1788940934.189022:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+16:14508:x1875840036104448:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788940934.189298:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+17:14508:x1875840036104448:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 Request processed in 276us (511us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788940934.189306:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 9 00000100:00100000:3.0:1788940934.192578:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.192701:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036104704 00000100:00100000:1.0:1788940934.192711:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036104704 00000100:00100000:1.0:1788940934.192771:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 48 00000100:00100000:1.0:1788940934.192781:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+17:14508:x1875840036104704:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788940934.193883:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+17:14508:x1875840036104704:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 1098us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940934.193905:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 48 00000100:00100000:0.0:1788940934.196884:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.197058:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036104832 00000100:00100000:1.0:1788940934.197068:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036104832 00000100:00100000:1.0:1788940934.197135:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 49 00000100:00100000:1.0:1788940934.197145:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+17:14508:x1875840036104832:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788940934.197165:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788940934.197230:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa42ec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226931 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.197341:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.197356:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.197368:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788940934.197416:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788940934.197435:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.197591:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa42ec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226931 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.197687:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226931 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.197698:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f41129a4600) 00010000:00010000:1.0:1788940934.197701:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788940934.197705:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f412bfc7c00, rc 0) 00000100:00100000:1.0:1788940934.197772:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+18:14508:x1875840036104832:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 627us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940934.197779:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 49 00000100:00100000:1.0:1788940934.204773:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940934.204864:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036104960 00000100:00100000:2.0:1788940934.204876:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036104960 00000100:00100000:2.0:1788940934.204941:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 14 00000100:00100000:2.0:1788940934.204950:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:2359:x1875840036104960:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788940934.204970:0:15116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788940934.204992:0:15116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9458561/0xa1d8aa9164aa42fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c226938 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788940934.205018:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa11285, blocks: 0x1 00010000:00010000:2.0:1788940934.205038:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=575s v=(0 0) 00010000:00010000:2.0:1788940934.205042:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940934.205051:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9458561/0xa1d8aa9164aa42fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226938 expref: 7 pid: 15116 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.205070:0:15116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9458561/0xa1d8aa9164aa42fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226938 expref: 7 pid: 15116 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.205105:0:15116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f400218c000, rc 0) 00000100:00100000:2.0:1788940934.205179:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:2359:x1875840036104960:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 220us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940934.205220:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 14 00000100:00100000:3.0:1788940934.208745:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.208810:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036105216 00000100:00100000:1.0:1788940934.208819:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036105216 00000100:00100000:1.0:1788940934.208898:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 50 00000100:00100000:1.0:1788940934.208910:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f40039c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+18:14508:x1875840036105216:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788940934.209093:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f40039c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+18:14508:x1875840036105216:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 185us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940934.209101:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 50 00000100:00100000:0.0:1788940934.212447:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940934.212572:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036105344 00000100:00100000:2.0:1788940934.212582:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036105344 00000100:00100000:2.0:1788940934.212639:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 51 00000100:00100000:2.0:1788940934.212650:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+18:14508:x1875840036105344:12345-192.168.202.17@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788940934.246667:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:1.0:1788940934.246689:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788940934.246714:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788940934.246928:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068599424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788940934.246998:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940934.247404:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+14:14508:x1875840036105344:12345-192.168.202.17@tcp:44:lhsmtool_posix.0 Request processed in 34752us (34964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940934.247416:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 51 00000100:00100000:1.0:1788940934.247505:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068599424 00000100:00100000:1.0:1788940934.247513:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068599424 00000100:00100000:1.0:1788940934.247560:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788940934.247568:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875840068599424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788940934.247718:0:16306:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788940934.247721:0:16306:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788940934.247723:0:16306:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788940934.247725:0:16306:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788940933 -> 1788940933 00002000:00010000:1.0:1788940934.247728:0:16306:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788940934.247851:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1875840068599424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 283us (852us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788940934.247858:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788940934.248054:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f4002582d80/2, rc 0, transno 8589934595 00000100:00100000:0.0:1788940934.248062:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3302:1875840068599424:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788940934.256059:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940934.256165:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036105472 00000100:00100000:2.0:1788940934.256176:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036105472 00000100:00100000:2.0:1788940934.256268:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 16 00000100:00100000:2.0:1788940934.256279:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:2358:x1875840036105472:12345-192.168.202.17@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788940934.256379:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:2358:x1875840036105472:12345-192.168.202.17@tcp:16:lhsmtool_posix.0 Request processed in 102us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940934.256387:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 16 00000100:00100000:2.0:1788940934.277988:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.278126:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036105728 00000100:00100000:1.0:1788940934.278137:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036105728 00000100:00100000:1.0:1788940934.278233:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 52 00000100:00100000:1.0:1788940934.278254:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+14:14508:x1875840036105728:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788940934.278308:0:14431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940934.278336:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc7c00/0xa1d8aa9164aa42f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226931 expref: 14 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.278359:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f41129a4600) 00010000:00010000:1.0:1788940934.278365:0:14431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788940934.278404:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa4301 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.278436:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa4301 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.278458:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa4301 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788940934.278834:0:14431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ceda940 reply state 000000003dd68b86 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa4301 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940934.278857:0:14431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788940934.278974:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+15:14508:x1875840036105728:12345-192.168.202.17@tcp:36:lhsmtool_posix.0 Request processed in 731us (996us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788940934.278982:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 52 00010000:00010000:3.0:1788940934.281851:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa4301 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.281872:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa4301 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.281881:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa4301 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.281898:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940934.281903:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa4301 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.281931:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa4301 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.281951:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f41129a4600) 00010000:00010000:3.0:1788940934.281954:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940934.281959:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa4301 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.281966:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f412bfc6e00/0xa1d8aa9164aa4301 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940934.282833:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940934.282924:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036105856 00000100:00100000:3.0:1788940934.282934:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036105856 00000100:00100000:3.0:1788940934.283037:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 17 00000100:00100000:3.0:1788940934.283049:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:14508:x1875840036105856:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788940934.283066:0:15114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788940934.283084:0:15114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa4308 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x803bd2c61c22693f expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.283116:0:15114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9458561/0xa1d8aa9164aa42fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226938 expref: 8 pid: 15116 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.283126:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940934.283130:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940934.283147:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa4308 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22693f expref: 8 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.283239:0:15114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9458561/0xa1d8aa9164aa42fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226938 expref: 8 pid: 15116 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.283253:0:15114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9458561/0xa1d8aa9164aa42fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226938 expref: 8 pid: 15116 timeout: 675 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940934.283268:0:15114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15114:1875840068599552:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940934.283367:0:15114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003400600 going to sleep for 11 seconds 00000100:00100000:3.0:1788940934.288589:0:15114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15114:1875840068599552:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940934.288632:0:15114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa4308 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22693f expref: 8 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.288654:0:15114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f4140f43600, rc 0) 00000100:00100000:3.0:1788940934.288782:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+8:14508:x1875840036105856:12345-192.168.202.17@tcp:101:lhsmtool_posix.0 Request processed in 5734us (5955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940934.288792:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 17 00000100:00100000:0.0:1788940934.298360:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940934.302511:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036105984 00000100:00100000:3.0:1788940934.302528:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036105984 00010000:00010000:0.0:1788940934.307380:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9458561/0xa1d8aa9164aa42fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226938 expref: 8 pid: 15116 timeout: 675 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940934.307552:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00100000:0.0:1788940934.307564:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+8:2359:x1875840036105984:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940934.307582:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940934.307615:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9458561/0xa1d8aa9164aa42fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226938 expref: 8 pid: 15116 timeout: 675 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.307632:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9458561/0xa1d8aa9164aa42fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226938 expref: 8 pid: 15116 timeout: 675 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.307658:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9458561/0xa1d8aa9164aa42fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c226938 expref: 8 pid: 15116 timeout: 675 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.307677:0:14417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940934.307682:0:14417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940934.307689:0:14417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa4308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22693f expref: 7 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.307699:0:14417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa4308 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22693f expref: 7 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.307741:0:14417:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa4308 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22693f expref: 7 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940934.307777:0:14417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134690a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14417:1875840068599680:192.168.202.17@tcp:105: 00000100:00100000:0.0:1788940934.307897:0:14417:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4108e9c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788940934.313490:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940934.313706:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036106112 00000100:00100000:3.0:1788940934.313716:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036106112 00000100:00100000:3.0:1788940934.313777:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:3.0:1788940934.313787:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+8:2359:x1875840036106112:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788940934.313998:0:15116:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788940934.314015:0:15116:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788940932 00002000:00010000:3.0:1788940934.314017:0:15116:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788940931 00002000:00010000:3.0:1788940934.314018:0:15116:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788940933 -> 1788940932 00002000:00010000:3.0:1788940934.314020:0:15116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788940934.314073:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:2359:x1875840036106112:12345-192.168.202.17@tcp:2:lhsmtool_posix.0 Request processed in 286us (592us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788940934.314080:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:0.0:1788940934.314163:0:14417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134690a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14417:1875840068599680:192.168.202.17@tcp:105: 00010000:00010000:0.0:1788940934.314184:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940934.314234:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+8:2359:x1875840036105984:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 6674us (15885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940934.314248:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 13 00000100:00100000:0.0:1788940934.317723:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.317804:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036106240 00000100:00100000:1.0:1788940934.317816:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036106240 00000100:00100000:1.0:1788940934.317873:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00100000:1.0:1788940934.317895:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15a33589-b4ad-4ff7-837c-6a5163a69b6e+8:2358:x1875840036106240:12345-192.168.202.17@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788940934.317941:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000243ffbb9/0xa1d8aa9164aa430f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.317963:0:16306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa4308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22693f expref: 8 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.317972:0:16306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940934.317977:0:16306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788940934.317981:0:16306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000243ffbb9/0xa1d8aa9164aa430f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.318034:0:16306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa4308 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22693f expref: 8 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940934.318048:0:16306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa4308 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22693f expref: 8 pid: 15114 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940934.318062:0:16306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f41420e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16306:1875840068599808:192.168.202.17@tcp:104: 00000100:00100000:1.0:1788940934.318149:0:16306:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41101d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788940934.321313:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.321536:0:16306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f41420e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16306:1875840068599808:192.168.202.17@tcp:104: 00010000:00010000:1.0:1788940934.321564:0:16306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000243ffbb9/0xa1d8aa9164aa430f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940934.321647:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036106368 00000100:00100000:2.0:1788940934.321654:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036106368 00010000:00010000:2.0:1788940934.321690:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa4308 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22693f expref: 9 pid: 15114 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940934.321730:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 14 00000100:00100000:2.0:1788940934.321756:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:2358:x1875840036106368:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788940934.321770:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788940934.321796:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa4308 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22693f expref: 9 pid: 15114 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.321809:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa4308 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22693f expref: 9 pid: 15114 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.321834:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018154dad/0xa1d8aa9164aa4308 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22693f expref: 9 pid: 15114 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.321850:0:14416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940934.321855:0:14416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788940934.321860:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000243ffbb9/0xa1d8aa9164aa430f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.321870:0:14416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000243ffbb9/0xa1d8aa9164aa430f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.321912:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788940934.321959:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+8:2358:x1875840036106368:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 205us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940934.321967:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 14 00010000:00010000:0.0:1788940934.322121:0:16306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000243ffbb9/0xa1d8aa9164aa430f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.322131:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000243ffbb9/0xa1d8aa9164aa430f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.322155:0:16306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000243ffbb9/0xa1d8aa9164aa430f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.322163:0:16306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000243ffbb9/0xa1d8aa9164aa430f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.322181:0:16306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000243ffbb9/0xa1d8aa9164aa430f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.322236:0:16306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc7c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940934.322246:0:16306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000243ffbb9/0xa1d8aa9164aa430f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.322257:0:16306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000243ffbb9/0xa1d8aa9164aa430f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.322270:0:16306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000243ffbb9/0xa1d8aa9164aa430f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.322278:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000243ffbb9/0xa1d8aa9164aa430f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940934.322331:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:2358:x1875840036106240:12345-192.168.202.17@tcp:1:lhsmtool_posix.0 Request processed in 4449us (4619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940934.322338:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00100000:0.0:1788940934.326697:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940934.326779:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036106624 00000100:00100000:3.0:1788940934.326790:0:14429:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036106624 00000100:00100000:3.0:1788940934.326860:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 53 00000100:00100000:3.0:1788940934.326871:0:14429:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+14:14508:x1875840036106624:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788940934.326967:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42400/0xa1d8aa9164aa4316 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.326985:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42400/0xa1d8aa9164aa4316 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.326997:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42400/0xa1d8aa9164aa4316 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.327311:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.327323:0:14429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa42e5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22692a expref: 15 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.327331:0:14429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.327366:0:14429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa42e5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22692a expref: 15 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.327388:0:14429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa42e5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22692a expref: 15 pid: 14429 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940934.327403:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1875840068599936:192.168.202.17@tcp:104: 00000100:00100000:3.0:1788940934.327483:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003400600 going to sleep for 11 seconds 00000100:00100000:2.0:1788940934.330291:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:0.0:1788940934.330393:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036106752 00000100:00100000:0.0:1788940934.330403:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036106752 00010000:00010000:0.0:1788940934.330440:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa42e5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22692a expref: 16 pid: 14429 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940934.330480:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 15 00000100:00100000:0.0:1788940934.330490:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002581500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+16:2358:x1875840036106752:12345-192.168.202.17@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940934.330504:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940934.330524:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa42e5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22692a expref: 16 pid: 14429 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.330537:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa42e5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22692a expref: 16 pid: 14429 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.330559:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f41129a4600) 00010000:00010000:0.0:1788940934.330565:0:14417:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.330580:0:14417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.330588:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.330606:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940934.330654:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002581500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+16:2358:x1875840036106752:12345-192.168.202.17@tcp:103:ldlm_bl.0 Request processed in 166us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940934.330662:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 15 00010000:00010000:3.0:1788940934.331109:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa42e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22692a expref: 15 pid: 14429 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940934.331127:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1875840068599936:192.168.202.17@tcp:104: 00010000:00010000:3.0:1788940934.331146:0:14429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.331155:0:14429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.331161:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940934.331635:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1788940934.331786:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1788940934.331832:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1788940934.331949:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f413508d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14429:1875840068600064:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788940934.332000:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940934.332025:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f4003400240 going to sleep for 11 seconds 00000100:00100000:0.0:1788940934.332110:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068600064 00000100:00100000:0.0:1788940934.332116:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068600064 00000100:00100000:0.0:1788940934.332161:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788940934.332170:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14429:x1875840068600064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788940934.332303:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14429:x1875840068600064:12345-0@lo:1000:mdt00_000.0 Request processed in 134us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940934.332311:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788940934.332443:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f413508d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14429:1875840068600064:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788940934.333084:0:14429:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788940934.333153:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002582300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14429:1875840068600192:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788940934.333227:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940934.333256:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114396c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788940934.333459:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068600192 00000100:00100000:0.0:1788940934.333465:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068600192 00000100:00100000:0.0:1788940934.333490:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788940934.333505:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4002583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14429:x1875840068600192:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788940934.333655:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4002583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14429:x1875840068600192:12345-0@lo:1000:mdt00_000.0 Request processed in 152us (428us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788940934.333663:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788940934.333824:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002582300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14429:1875840068600192:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788940934.334396:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334409:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334417:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334423:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f42600 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940934.334427:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334436:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334452:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f41129a4600) 00010000:00010000:2.0:1788940934.334455:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940934.334461:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334467:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42600/0xa1d8aa9164aa431d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334504:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4275 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334511:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4275 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334530:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4275 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334536:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36000 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:2.0:1788940934.334539:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4275 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334545:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4275 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334554:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:2.0:1788940934.334557:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788940934.334564:0:14429:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa427c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22690e expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334578:0:14429:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa427c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22690e expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334587:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa427c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22690e expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.334619:0:14429:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b37800/0xa1d8aa9164aa427c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.17@tcp remote: 0x803bd2c61c22690e expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940934.334632:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4002581880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1875840068600320:192.168.202.17@tcp:105: 00000100:00100000:2.0:1788940934.334705:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f41114396c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788940934.337915:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4002581880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14429:1875840068600320:192.168.202.17@tcp:105: 00010000:00010000:3.0:1788940934.337945:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4275 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.337970:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4113b36000/0xa1d8aa9164aa4275 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338000:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa4324 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338014:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa4324 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338024:0:14429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa4324 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338035:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa4324 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338042:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa4324 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338049:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa4324 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338065:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f43200 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940934.338069:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa4324 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338076:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa4324 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338086:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:3.0:1788940934.338089:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940934.338093:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa4324 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338104:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43200/0xa1d8aa9164aa4324 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338116:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42400/0xa1d8aa9164aa4316 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338121:0:14429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42400/0xa1d8aa9164aa4316 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338127:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42400/0xa1d8aa9164aa4316 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338132:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f42400 already unused, calling callback (ffffffffc1ed04f0) 00010000:00010000:3.0:1788940934.338135:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42400/0xa1d8aa9164aa4316 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338141:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42400/0xa1d8aa9164aa4316 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338147:0:14429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f410ad9f200) 00010000:00010000:3.0:1788940934.338149:0:14429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788940934.338152:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42400/0xa1d8aa9164aa4316 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.338157:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f42400/0xa1d8aa9164aa4316 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14429 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940934.338404:0:14429:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+18:14508:x1875840036106624:12345-192.168.202.17@tcp:57:lhsmtool_posix.0 Request processed in 11533us (11715us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788940934.338414:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 53 00000020:00080000:3.0:1788940934.338423:0:14429:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788940934.338712:0:14463:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788940934.338717:0:14463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940934.338753:0:14463:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788940934.338759:0:14463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788940934.343287:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:3.0:1788940934.343458:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036107008 00000100:00100000:3.0:1788940934.343467:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036107008 00000100:00100000:3.0:1788940934.343515:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 10 00000100:00100000:3.0:1788940934.343522:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a5f5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+18:14508:x1875840036107008:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788940934.344097:0:14432:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788940934.344494:0:14432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788940934.344533:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa432b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.344548:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa432b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.344557:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa432b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.344563:0:14432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa432b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.344568:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa432b lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.344571:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa432b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.344590:0:14432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788940934.344673:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a5f5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+20:14508:x1875840036107008:12345-192.168.202.17@tcp:35:lhsmtool_posix.0 Request processed in 1150us (1394us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788940934.344679:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 10 00000020:00080000:3.0:1788940934.344683:0:14432:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788940934.344988:0:16078:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940934.344994:0:16078:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa432b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.345007:0:16078:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f43a00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940934.345010:0:16078:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa432b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.345017:0:16078:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa432b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.345029:0:16078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f41129a4600) 00010000:00010000:2.0:1788940934.345031:0:16078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788940934.345036:0:16078:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa432b lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.345047:0:16078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f4140f43a00/0xa1d8aa9164aa432b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.345058:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940934.345060:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940934.345062:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940934.346689:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940934.348474:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036107136 00000100:00100000:2.0:1788940934.348491:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036107136 00000100:00100000:2.0:1788940934.348612:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:2.0:1788940934.348623:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+20:14507:x1875840036107136:12345-192.168.202.17@tcp:49:dd.0 00000100:00100000:2.0:1788940934.348766:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+20:14507:x1875840036107136:12345-192.168.202.17@tcp:49:dd.0 Request processed in 144us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940934.348774:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 11 00000100:00100000:1.0:1788940934.526299:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.526339:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.526372:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940934.526480:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036107264 00000100:00100000:2.0:1788940934.526491:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036107264 00000100:00100000:2.0:1788940934.526541:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036107392 00000100:00100000:2.0:1788940934.526544:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036107392 00000100:00100000:2.0:1788940934.526589:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036107520 00000100:00100000:2.0:1788940934.526592:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036107520 00000100:00100000:2.0:1788940934.526727:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:2.0:1788940934.526739:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:2358:x1875840036107264:12345-192.168.202.17@tcp:4:dd.0 00002000:00010000:2.0:1788940934.526796:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa11284, atime: 0x6aa11283, ctime: 0x6aa11284, blocks: 0x1 00010000:00010000:2.0:1788940934.526806:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4332 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.526823:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=575s v=(0 0) 00010000:00010000:2.0:1788940934.526828:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940934.526834:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.526849:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940934.608421:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1788940934.608444:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:1.0:1788940934.608450:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1788940934.608556:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1788940934.608560:0:15119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788940932 -> 1788940933 00002000:00010000:2.0:1788940934.608563:0:15119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1788940934.608738:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.608752:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.608761:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.608789:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f400218d400 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940934.608794:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.608803:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4332 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.608823:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4332 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.608831:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4332 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940934.608992:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:2358:x1875840036107264:12345-192.168.202.17@tcp:4:dd.0 Request processed in 82251us (82698us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788940934.609003:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 0 00000100:00100000:2.0:1788940934.609036:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 1 00000100:00100000:2.0:1788940934.609048:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:2358:x1875840036107392:12345-192.168.202.17@tcp:4:dd.0 00002000:00010000:2.0:1788940934.609086:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6aa11285, atime: 0x6aa11283, ctime: 0x0, blocks: 0x803 00010000:00010000:2.0:1788940934.609093:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4339 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.609105:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=575s v=(0 0) 00010000:00010000:2.0:1788940934.609109:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940934.609115:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.609134:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.666869:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788940934.681520:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:3.0:1788940934.681529:0:15119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:3.0:1788940934.681544:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.681557:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.681566:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.681573:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f400218c600 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940934.681578:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.681587:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.681605:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4339 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.681612:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa4339 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940934.681712:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+8:2358:x1875840036107392:12345-192.168.202.17@tcp:4:dd.0 Request processed in 72663us (155367us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788940934.681726:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 1 00000100:00100000:3.0:1788940934.681781:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 2 00000100:00100000:3.0:1788940934.681794:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:2358:x1875840036107520:12345-192.168.202.17@tcp:4:dd.0 00002000:00010000:3.0:1788940934.681832:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6aa11285, atime: 0x6aa11283, ctime: 0x0, blocks: 0x1007 00010000:00010000:3.0:1788940934.681839:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039da6a33/0xa1d8aa9164aa4340 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.681850:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=575s v=(0 0) 00010000:00010000:3.0:1788940934.681854:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788940934.681860:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039da6a33/0xa1d8aa9164aa4340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.681871:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039da6a33/0xa1d8aa9164aa4340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788940934.682396:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1788940934.769782:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:3.0:1788940934.769966:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1788940934.769981:0:15119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1788940934.769999:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039da6a33/0xa1d8aa9164aa4340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.770012:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039da6a33/0xa1d8aa9164aa4340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.770021:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039da6a33/0xa1d8aa9164aa4340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.770028:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4140f42400 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:3.0:1788940934.770034:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039da6a33/0xa1d8aa9164aa4340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.770130:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039da6a33/0xa1d8aa9164aa4340 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.770154:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039da6a33/0xa1d8aa9164aa4340 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940934.770162:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039da6a33/0xa1d8aa9164aa4340 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940934.770458:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2358:x1875840036107520:12345-192.168.202.17@tcp:4:dd.0 Request processed in 88664us (244080us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788940934.770468:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 2 00000100:00100000:1.0:1788940934.779438:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.779514:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.779558:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.779592:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940934.779612:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:2.0:1788940934.779687:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036107648 00000100:00100000:2.0:1788940934.779697:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036107648 00000100:00100000:2.0:1788940934.779755:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036107776 00000100:00100000:2.0:1788940934.779759:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036107776 00000100:00100000:2.0:1788940934.779773:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036107904 00000100:00100000:2.0:1788940934.779776:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036107904 00000100:00100000:2.0:1788940934.779788:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036108032 00000100:00100000:2.0:1788940934.779790:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036108032 00000100:00100000:2.0:1788940934.779801:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036108160 00000100:00100000:2.0:1788940934.779804:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036108160 00000100:00100000:2.0:1788940934.779821:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 3 00000100:00100000:2.0:1788940934.779830:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:2359:x1875840036107648:12345-192.168.202.17@tcp:4:dd.0 00002000:00010000:2.0:1788940934.779897:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aa11285, atime: 0x6aa11283, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1788940934.779907:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4347 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.779925:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=576s v=(0 0) 00010000:00010000:2.0:1788940934.779930:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940934.779937:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940934.779951:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940934.857635:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:0.0:1788940934.857720:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1788940934.857726:0:15119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1788940934.857740:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.857753:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.857762:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.857770:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f400218d400 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940934.857775:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.857785:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4347 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.857803:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4347 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.857830:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028468d59/0xa1d8aa9164aa4347 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940934.857933:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:2359:x1875840036107648:12345-192.168.202.17@tcp:4:dd.0 Request processed in 78098us (78500us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788940934.857946:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 3 00000100:00100000:0.0:1788940934.857976:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 4 00000100:00100000:0.0:1788940934.857986:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+8:2358:x1875840036107776:12345-192.168.202.17@tcp:4:dd.0 00002000:00010000:0.0:1788940934.858026:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 4194304, mtime: 0x6aa11285, atime: 0x6aa11283, ctime: 0x0, blocks: 0x2007 00010000:00010000:0.0:1788940934.858032:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcb96566/0xa1d8aa9164aa434e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.858045:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788940934.858050:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940934.858055:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb96566/0xa1d8aa9164aa434e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.858068:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcb96566/0xa1d8aa9164aa434e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940934.947225:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1788940934.947235:0:15119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1788940934.947251:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcb96566/0xa1d8aa9164aa434e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.947285:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb96566/0xa1d8aa9164aa434e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.947295:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcb96566/0xa1d8aa9164aa434e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.947302:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b37c00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940934.947307:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcb96566/0xa1d8aa9164aa434e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.947317:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcb96566/0xa1d8aa9164aa434e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.947338:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcb96566/0xa1d8aa9164aa434e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.947347:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcb96566/0xa1d8aa9164aa434e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940934.947449:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+10:2358:x1875840036107776:12345-192.168.202.17@tcp:4:dd.0 Request processed in 89461us (167930us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788940934.947459:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 4 00000100:00100000:0.0:1788940934.947488:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:0.0:1788940934.947497:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+9:2359:x1875840036107904:12345-192.168.202.17@tcp:4:dd.0 00002000:00010000:0.0:1788940934.947532:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 5242880, mtime: 0x6aa11285, atime: 0x6aa11283, ctime: 0x0, blocks: 0x2807 00010000:00010000:0.0:1788940934.947544:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa4355 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.947554:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788940934.947558:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788940934.947564:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa4355 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940934.947574:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa4355 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788940934.947869:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:1.0:1788940935.001019:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:2.0:1788940935.001143:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:2.0:1788940935.001148:0:15119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:2.0:1788940935.001161:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa4355 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.001175:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa4355 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.001185:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa4355 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.001219:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f4113b36000 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:2.0:1788940935.001224:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa4355 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.001234:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa4355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.001253:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa4355 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.001260:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4c3b880/0xa1d8aa9164aa4355 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788940935.001350:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:2359:x1875840036107904:12345-192.168.202.17@tcp:4:dd.0 Request processed in 53850us (221786us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788940935.001372:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 5 00000100:00100000:2.0:1788940935.001401:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00100000:2.0:1788940935.001411:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f41420e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:2358:x1875840036108032:12345-192.168.202.17@tcp:4:dd.0 00002000:00010000:2.0:1788940935.001444:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 6291456, mtime: 0x6aa11285, atime: 0x6aa11283, ctime: 0x0, blocks: 0x3007 00010000:00010000:2.0:1788940935.001450:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa435c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.001461:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=576s v=(0 0) 00010000:00010000:2.0:1788940935.001466:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788940935.001471:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa435c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.001482:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa435c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788940935.070706:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1788940935.070865:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1788940935.070871:0:15119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1788940935.070899:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa435c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.070916:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa435c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.070926:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa435c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.070994:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f400218c600 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:1.0:1788940935.071000:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa435c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.071011:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa435c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.071037:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa435c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.071104:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007239f04a/0xa1d8aa9164aa435c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940935.071543:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f41420e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+6:2358:x1875840036108032:12345-192.168.202.17@tcp:4:dd.0 Request processed in 70127us (291941us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788940935.071562:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 6 00000100:00100000:1.0:1788940935.071606:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 7 00000100:00100000:1.0:1788940935.071621:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413a66dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2359:x1875840036108160:12345-192.168.202.17@tcp:4:dd.0 00002000:00010000:1.0:1788940935.071674:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 7340032, mtime: 0x6aa11285, atime: 0x6aa11283, ctime: 0x0, blocks: 0x3807 00010000:00010000:1.0:1788940935.071682:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa4363 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.071696:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788940935.071701:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788940935.071708:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa4363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.071721:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa4363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788940935.138952:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1788940935.138965:0:15119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788940933 00002000:00010000:0.0:1788940935.138968:0:15119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1788940935.138988:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa4363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940935.139006:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa4363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940935.139016:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa4363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940935.139025:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f412bfc6e00 already unused, calling callback (ffffffffc14748b0) 00010000:00010000:0.0:1788940935.139032:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa4363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940935.139288:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa4363 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940935.139317:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa4363 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940935.139327:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000221dd82e/0xa1d8aa9164aa4363 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788940935.139471:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413a66dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:15a33589-b4ad-4ff7-837c-6a5163a69b6e+7:2359:x1875840036108160:12345-192.168.202.17@tcp:4:dd.0 Request processed in 67848us (359849us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788940935.139483:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 7 00000001:00080000:3.0:1788940935.139653:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:1.0:1788940935.692389:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940936.362753:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940936.362794:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940936.362820:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940936.362841:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940936.362861:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940936.362892:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940936.362917:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.17@tcp (source: 12345-192.168.202.17@tcp) 00000100:00100000:1.0:1788940936.362956:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036108288 00000100:00100000:1.0:1788940936.362967:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036108288 00000100:00100000:1.0:1788940936.363013:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 126 00000100:00100000:1.0:1788940936.363023:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f410f587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+13:2361:x1875840036108288:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940936.363092:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f410f587850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:36ee986b-e339-4da7-8006-c8ec2882b900+13:2361:x1875840036108288:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 71us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940936.363100:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 126 00000100:00100000:1.0:1788940936.363149:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036108544 00000100:00100000:1.0:1788940936.363154:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036108544 00000100:00100000:1.0:1788940936.363184:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036109056 00000100:00100000:1.0:1788940936.363212:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036109056 00000100:00100000:1.0:1788940936.363229:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036108672 00000100:00100000:1.0:1788940936.363232:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036108672 00000100:00100000:1.0:1788940936.363243:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036108928 00000100:00100000:1.0:1788940936.363245:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036108928 00000100:00100000:1.0:1788940936.363259:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 16 00000100:00100000:1.0:1788940936.363266:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2361:x1875840036108544:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940936.363293:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2361:x1875840036108544:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 28us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940936.363299:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 16 00000100:00100000:1.0:1788940936.363310:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 17 00000100:00100000:1.0:1788940936.363316:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+5:2361:x1875840036109056:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940936.363339:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+5:2361:x1875840036109056:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 23us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940936.363345:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 17 00000100:00100000:1.0:1788940936.363358:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:1.0:1788940936.363364:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2361:x1875840036108672:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940936.363397:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:15a33589-b4ad-4ff7-837c-6a5163a69b6e+5:2361:x1875840036108672:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 32us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940936.363403:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 18 00000100:00100000:1.0:1788940936.363416:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00100000:1.0:1788940936.363422:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+5:2361:x1875840036108928:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940936.363443:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+5:2361:x1875840036108928:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 21us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940936.363448:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 19 00000100:00100000:1.0:1788940936.363466:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036108800 00000100:00100000:1.0:1788940936.363469:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036108800 00000100:00100000:1.0:1788940936.363493:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840036108416 00000100:00100000:1.0:1788940936.363496:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840036108416 00000100:00100000:1.0:1788940936.363512:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 30 00000100:00100000:1.0:1788940936.363519:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:2361:x1875840036108800:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940936.363552:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad5c5f24-5413-4c25-9f52-f7f2bcff2739+6:2361:x1875840036108800:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 33us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940936.363558:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 30 00000100:00100000:1.0:1788940936.363572:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.17@tcp, seq: 31 00000100:00100000:1.0:1788940936.363578:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f4134c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+20:2361:x1875840036108416:12345-192.168.202.17@tcp:400:kworker.0 00000100:00100000:1.0:1788940936.363603:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f4134c55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:15a33589-b4ad-4ff7-837c-6a5163a69b6e+20:2361:x1875840036108416:12345-192.168.202.17@tcp:400:kworker.0 Request processed in 26us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940936.363609:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.17@tcp, seq: 31 00000100:00080000:1.0:1788940936.363772:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788940936.363777:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788940936.363780:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788940936.650433:0:16697:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788940936.720763:0:16078:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940937.736418:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940937.736959:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f4134691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068600448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940937.737053:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940937.737546:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875840068600448 00000100:00100000:1.0:1788940937.737556:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875840068600448 00000100:00100000:1.0:1788940937.737628:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788940937.737638:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8f413508f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068600448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788940937.737740:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788940937.737796:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8f413508f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875840068600448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940937.737804:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940937.737906:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f4134691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3303:1875840068600448:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788940937.738023:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 30083 lines, 30083 kept, 0 dropped, 0 bad.